-- Logs begin at Wed 2022-07-27 03:15:10 UTC, end at Wed 2022-07-27 04:41:23 UTC. -- Jul 27 04:13:04.361159 dv-cinder-850989-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 04:13:04.370479 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 04:13:04.372778 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 04:13:04 2022] *** Jul 27 04:13:04.372778 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 04:13:04.372778 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 04:13:04.372778 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: nodename: dv-cinder-850989-2-iscsi Jul 27 04:13:04.372778 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: machine: x86_64 Jul 27 04:13:04.372778 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: clock source: unix Jul 27 04:13:04.372778 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: pcre jit disabled Jul 27 04:13:04.372778 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: detected number of CPU cores: 4 Jul 27 04:13:04.372778 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: current working directory: / Jul 27 04:13:04.372778 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: detected binary path: /usr/bin/uwsgi-core Jul 27 04:13:04.373563 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: your processes number limit is 47680 Jul 27 04:13:04.373563 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: your memory page size is 4096 bytes Jul 27 04:13:04.373563 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: detected max file descriptor number: 2048 Jul 27 04:13:04.373563 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: lock engine: pthread robust mutexes Jul 27 04:13:04.373563 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: thunder lock: enabled Jul 27 04:13:04.373563 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 04:13:04.373563 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 04:13:04.412351 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: Python main interpreter initialized at 0x55f4e941f9c0 Jul 27 04:13:04.412351 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: python threads support enabled Jul 27 04:13:04.412351 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: your server socket listen backlog is limited to 100 connections Jul 27 04:13:04.412351 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: your mercy for graceful operations on workers is 90 seconds Jul 27 04:13:04.412693 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 04:13:04.412771 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: *** Operational MODE: preforking *** Jul 27 04:13:04.413004 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: *** uWSGI is running in multiple interpreter mode *** Jul 27 04:13:04.413004 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: spawned uWSGI master process (pid: 103223) Jul 27 04:13:04.413188 dv-cinder-850989-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 04:13:04.414373 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: spawned uWSGI worker 1 (pid: 103224, cores: 1) Jul 27 04:13:04.414373 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: spawned uWSGI worker 2 (pid: 103225, cores: 1) Jul 27 04:13:04.414373 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 04:13:05.073601 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 04:13:05.076492 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 04:13:06.167442 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 04:13:06.167442 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: from cryptography.utils import int_from_bytes Jul 27 04:13:06.168134 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 04:13:06.168134 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: from cryptography.utils import int_from_bytes Jul 27 04:13:06.172121 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 04:13:06.172121 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: from cryptography.utils import int_from_bytes Jul 27 04:13:06.172543 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 04:13:06.172543 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: from cryptography.utils import int_from_bytes Jul 27 04:13:08.644904 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 04:13:08.645462 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 04:13:08.645666 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 04:13:08.646041 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 04:13:08.646292 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 04:13:08.646667 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.646989 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.647311 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.647623 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.647948 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.648253 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.648568 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.648880 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.649202 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.649459 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.649767 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.650125 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850989-2-iscsi {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.650443 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.650746 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.650841 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 04:13:08.651807 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 04:13:08.651888 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.652011 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.652171 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 04:13:08.652318 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.652542 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 04:13:08.652637 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.652797 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 04:13:08.652932 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.653184 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.653424 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.653811 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.653811 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.654089 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.654203 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.654320 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.654470 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.654592 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.654781 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.654911 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.655101 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.655233 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.655406 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.655493 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.655722 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.655846 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.655983 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.656070 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.656300 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.656433 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.656622 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.656718 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850989-2-iscsi {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.656944 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.657038 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850989-2-iscsi {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.657251 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.657353 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.657563 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.657661 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.657887 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.658079 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.658241 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.658409 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.658546 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.658639 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.658853 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.658940 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.659214 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.659358 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.659543 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.659669 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.659856 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.660009 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.660170 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.660303 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.660484 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.660601 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.660798 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.660916 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.661112 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.661215 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.661411 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.661535 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.661715 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.661844 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.662040 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.662192 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.662353 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.662503 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.662655 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.662900 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850989-2-iscsi {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.662987 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.663189 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.663277 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.663494 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.663588 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.663811 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.663898 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.664126 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.664214 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.664441 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.664541 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.664688 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.664812 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.664933 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.665132 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.665245 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.665452 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.665560 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.665760 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.665855 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.666122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.666210 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.666443 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.666587 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.666795 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.666982 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.667099 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.667320 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.667406 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.667629 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.667730 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.667943 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.668096 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.668257 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.668345 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.668580 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.668685 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.668888 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.668982 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.669187 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.669280 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.669442 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.669525 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.669734 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.669875 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.670078 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.670214 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.670402 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.670516 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.670724 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.670847 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.670975 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.671161 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.671250 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.671467 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.671564 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.671780 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.671875 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.672093 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.672182 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.672395 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.672483 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.672694 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.672794 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.672995 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.673083 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.673305 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.673392 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.673618 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.673729 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.673913 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.674036 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.674183 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.674271 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.674478 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.674574 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.674776 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.674863 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.675086 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.675182 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.675385 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.675481 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.675684 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.675772 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.675983 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.676135 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.676277 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.676377 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.676578 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.676665 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.676877 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.677007 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.677178 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.677324 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.677483 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.677633 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.677783 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.677953 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.678106 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.678295 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.678393 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.678604 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.678690 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.678911 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.679010 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.679217 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.679304 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.679535 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.679636 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.679856 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.679951 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.680156 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.680244 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.680406 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.680494 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.680708 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.680808 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.681011 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.681098 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.681324 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.681410 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.681621 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.681718 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.681924 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.682076 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.682284 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.682371 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.682586 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.682676 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.682896 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.683124 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.683212 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.683438 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.683535 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.683755 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.683843 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.684057 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.684151 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.684359 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.684458 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.684665 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.684750 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.684962 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.685055 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.685260 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.685357 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.685557 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.685645 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.685854 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.685951 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.686175 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.686269 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.686475 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.686562 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.686772 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.686866 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.687069 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.687159 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.687368 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.687464 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.687679 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.687769 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.687985 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.688072 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.688286 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.688371 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.688587 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.688713 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.688886 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.689227 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.689444 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.689531 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.689763 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.689850 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.690098 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.690199 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.690408 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.690498 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.690725 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.690812 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.691024 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.691113 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.691329 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.691416 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.691647 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.691749 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.691954 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.692042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.692259 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.692345 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.692563 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.692658 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.692865 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.692952 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.693165 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.693261 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.693467 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.693565 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.693774 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.693859 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.694102 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.694202 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.694403 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.694499 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.694720 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.694807 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.695032 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.695120 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.695341 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.695429 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.695646 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.695739 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.695953 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.696041 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.696270 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:13:08.696360 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.696580 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.696666 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.696885 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.696971 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.697223 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.697312 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.697548 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.697654 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.698449 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.698554 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.698851 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.698954 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.699223 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.699397 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.699539 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.699703 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.699857 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.700008 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.700185 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.700326 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.700499 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.700651 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.700814 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.700958 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.701127 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.701271 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.701446 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.701577 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.701763 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.701885 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.702116 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.702225 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.702434 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.702530 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.702752 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.702838 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.703071 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.703165 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.703385 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.703474 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.703701 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.703795 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.704007 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.704094 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.704319 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.704408 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.704625 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.704719 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.704930 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.705027 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.705281 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.705376 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.705537 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.705626 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.705836 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.705933 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.706164 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.706305 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.706455 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.706596 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.706756 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.706901 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.707070 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.707216 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.707391 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.707525 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.707692 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.707838 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.708050 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.708198 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.708336 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.708470 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.708613 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.708749 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.708925 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.709064 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.709207 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.709340 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.709481 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.709614 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.709774 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.709907 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.710108 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.710250 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.710396 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.710533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.710696 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.710818 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.711000 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.711094 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.711302 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.711402 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.711621 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.711730 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.711918 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.712018 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.712216 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.712305 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.712525 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.712614 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.712832 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.712932 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.713137 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.713226 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.713524 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.714156 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.714343 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.714609 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.714706 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.714788 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.714986 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.715086 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.715296 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.715409 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.715630 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.715738 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.715938 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.716088 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.716251 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.716350 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.716563 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.716673 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.716873 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.716971 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.717179 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.717284 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.717476 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.717581 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.717781 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.717879 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.718106 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.718198 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.718406 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.718493 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.718708 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.718822 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.719011 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.719102 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.719314 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.719414 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.719617 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.719782 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.719919 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.720012 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.720218 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.720305 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.720522 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.720683 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.720816 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.720903 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.721128 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.721219 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.721426 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.721524 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.721726 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.721815 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.722046 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.722140 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.722371 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.722477 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.722674 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.722761 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.723010 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.723111 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.723319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.723426 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.723643 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.723742 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.723962 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.724062 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.724272 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.724371 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.724575 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.724671 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.724878 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.724975 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.725181 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.725277 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.725484 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.725583 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.725789 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.725886 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.726123 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.726233 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.726429 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.726528 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.726733 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.726830 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.727037 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.727141 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.727339 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.727435 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.727645 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.727753 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.727963 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.728059 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.728263 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.728362 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.728566 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.728677 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.728871 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.728969 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.729298 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.729473 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.729557 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.729652 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.729855 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.730020 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.730185 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.730330 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.730495 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.730658 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.730812 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.730946 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.731085 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.731223 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.731385 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.731519 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.731678 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.731820 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.731992 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.732132 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.732300 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.732437 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.732615 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.732756 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.732920 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.733055 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.733237 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.733389 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.733536 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.733675 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.733843 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.734040 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.734189 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.734329 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.734510 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.734654 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.734795 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.734934 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.735090 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.735229 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.735377 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.735515 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.735652 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.735798 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.735966 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.736102 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.736272 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.736412 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.736579 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.736722 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.736868 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.737007 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.737169 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.737317 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.737456 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.737606 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.737757 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.737896 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.738066 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.738248 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.738383 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.738561 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.738703 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.738879 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.739003 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.739202 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.739357 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.739514 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.739649 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.739817 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.739958 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.740104 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.740254 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.740393 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.740538 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.740710 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.740863 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.741014 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.741170 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.741311 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.741449 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.741616 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.741750 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.741898 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.742065 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.742222 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.742356 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.742537 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.742672 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.742842 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.742985 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.743145 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.743286 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.743432 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.743578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.743725 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.743864 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.744029 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.744170 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.744335 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.744472 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.744620 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.744797 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.744973 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.745130 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.745266 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.745401 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.745549 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.745642 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.745858 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.746035 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.746188 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.746289 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.746492 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.746580 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.746798 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.746893 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.747103 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.747200 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.747404 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.747492 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.747710 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.747800 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.748091 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.748254 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.748327 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.748462 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.748614 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.748705 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.748928 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.749032 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.749232 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.749370 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.749537 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.749624 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.749839 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.749928 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.750161 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.750266 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.750467 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.750554 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.750773 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.750872 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.751077 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.751333 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.751423 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.751666 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.751763 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.751979 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.752066 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.752293 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.752383 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.752610 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.752705 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.752923 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.753017 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.753237 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.753325 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.753546 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.753636 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.753854 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.753942 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.754204 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.754303 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.754514 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.754601 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.754819 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.754909 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.755120 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.755208 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.755425 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.755522 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.755728 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.755817 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.756030 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.756120 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.756330 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.756436 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.756634 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.756730 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.756934 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.757024 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.757232 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.757329 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.757532 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.757618 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.757833 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.757929 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.758165 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.758273 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.758465 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.758722 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.758810 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.759054 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.759150 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.759368 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.759457 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.759672 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.759760 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.759973 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.760071 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.760798 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.760925 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.761135 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.761274 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.761462 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.761561 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.761788 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.761875 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.762119 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.762228 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.762434 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.762523 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.762742 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.762832 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.763049 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.763137 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.763348 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.763434 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.763653 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.763748 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.763953 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.764041 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.764253 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.764353 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.764554 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.764649 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.764855 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.764942 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.765155 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.765251 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.765453 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.765548 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.765753 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.765839 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.766076 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.766177 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.766383 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.766477 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.766684 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.766771 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.766985 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.767080 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.767287 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.767375 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.767585 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.767673 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.767890 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.767987 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.768189 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.768284 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.768490 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.768585 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.768783 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.768871 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.769085 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.769219 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.769387 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.769485 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.769684 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.769782 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.770032 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.770127 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.770302 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.770391 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.770611 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.770702 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.770910 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.771009 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.771211 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.771362 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.771509 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.771600 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.771811 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.771906 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.772116 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.772287 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.772413 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.772502 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.772729 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.772818 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.773034 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.773131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.773334 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.773423 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.773632 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.773729 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.773939 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.774086 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.774260 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.774361 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.774556 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.774646 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.774860 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.774949 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.775171 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.775268 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.775480 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.775569 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.775778 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.775898 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.776617 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.776706 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.776919 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.777008 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.777218 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.777307 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.777515 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.777602 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.777819 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.777905 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.778145 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.778248 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.778453 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.778540 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.778752 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.778851 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.779048 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.779135 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.779345 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.779443 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.779651 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.779759 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.779950 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.780039 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.780248 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.780337 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.780548 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.780645 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.780845 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.780933 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.781166 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.781252 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.781456 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.781561 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.781761 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.781849 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.782085 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.782193 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.782406 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.782525 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.782718 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.782844 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.783022 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.783169 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.783328 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.783484 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.783634 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.783822 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.783920 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.784098 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.784227 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.784408 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.784531 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.784709 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.784837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.785013 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.785135 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.785318 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.785431 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.785620 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.785746 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.785922 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.786071 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.786250 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.786376 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.786554 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.786690 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.786856 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.787005 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.787177 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.787321 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.787483 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.787619 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.787787 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.787922 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.788090 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.788227 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.788393 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.788535 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.788735 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.788832 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.789038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.789127 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.789395 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.789490 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.789704 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.789820 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.790026 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.790141 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.790332 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.790437 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.790636 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.790725 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.790937 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.791025 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.791240 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.791398 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.791561 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.791720 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.791864 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.792101 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.792271 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.792453 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.792545 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.792751 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.792840 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.793056 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.793145 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.793357 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.793461 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.793663 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.793753 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.793966 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.794099 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.794366 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.794454 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.794689 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.794787 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.794993 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.795090 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.795293 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.795382 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.795599 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.795687 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.795902 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.796003 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.796211 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.796298 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.796516 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.796604 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.796815 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.796916 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.797121 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.797230 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.797431 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.797542 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.797742 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.797840 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.798073 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.798168 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.798385 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.798475 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.798693 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.798790 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.798997 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.799085 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.799306 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.799395 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.799614 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.799704 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.799915 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.800012 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.800215 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.800303 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.800530 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.800618 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.800827 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.800922 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.801131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.801293 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.801438 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.801528 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.801755 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.801870 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.802082 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.802198 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.802507 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.802608 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.802821 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.802918 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.803129 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.803236 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.803432 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.803535 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.803742 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.803895 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.804052 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.804201 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.804344 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.804482 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.804648 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.804783 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.804954 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.805089 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.805273 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.805416 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.805589 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.805723 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.805897 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.806054 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.806234 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.806322 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.806535 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.806633 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.806855 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.806945 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.807204 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.807344 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.807507 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.807655 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.807823 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.807967 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.808233 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.808324 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.808556 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.808669 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.808864 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.808961 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.809167 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.809256 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.809487 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.809574 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.809789 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.809887 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.810114 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.810207 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.810421 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.810511 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.810725 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.810914 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.811013 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.811225 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.811313 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.811593 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.811712 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.811878 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.811964 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.812164 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.812264 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.812486 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.812583 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.812783 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.812872 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.813081 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.813169 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.813392 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.813488 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.813688 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.813776 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.814277 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.814376 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.814590 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.814697 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.814906 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.814995 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.815213 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.815309 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.815513 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.815609 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.815831 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.815920 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.816135 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.816223 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.816435 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.816532 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.816734 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.816855 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.817035 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.817179 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.817370 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.817488 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.817668 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.817809 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.818006 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.818159 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.818467 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.818644 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.818770 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.818969 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.819081 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.819276 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.819375 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.819604 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.819693 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.819926 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.820025 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.820238 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.820335 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.820549 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.820638 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.820865 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.820952 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.821163 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.821258 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.821460 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.821549 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.821762 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.821861 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.822079 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.822197 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.822383 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.822491 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.822678 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.823278 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.823502 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.823594 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.823829 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.823931 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.824184 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.824272 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.824491 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.824604 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.824819 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.824908 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.825117 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.825214 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.825422 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.825509 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.825724 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.825861 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.826047 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.826154 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.826351 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.826440 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.826650 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.826747 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.826987 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.827083 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.827283 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.827372 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.827608 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.827696 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.827918 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.828018 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.828235 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.828325 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.828556 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.828654 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.828859 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.828957 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.829173 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.829261 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.829486 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.829573 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.829787 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.829876 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.830117 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.830209 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.830430 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.830522 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.830734 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.830824 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.831035 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.831124 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.831341 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.831430 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.831644 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.831732 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.831946 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.832044 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.832246 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.832343 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.832559 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.832686 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.832872 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.833074 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.833163 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.833597 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.833912 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.834251 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.834570 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.834851 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.835012 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.835177 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.835328 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.835478 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.835629 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.835776 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.835936 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.836088 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.836238 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.836378 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.836524 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.836640 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.837155 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.837412 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.837508 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.837762 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.837859 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.838113 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.838230 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.838525 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.839125 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.839371 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.839550 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.839687 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.839921 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.840011 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.840279 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.840371 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.840793 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.841101 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.841415 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.841729 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.842067 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.842376 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.842800 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.842987 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.843139 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.843281 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.843462 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.843586 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.843771 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.844010 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.844098 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.844376 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.844616 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.844711 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.844994 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.845224 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.845319 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.845624 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.845824 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.845920 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.846255 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.846463 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.846552 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.846958 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.847271 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.847433 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.847595 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.847839 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.848006 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.848182 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.848361 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.848515 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.848672 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.848829 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.848984 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.849138 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.849256 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.849406 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.849497 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.849764 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.849955 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.850132 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.850279 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.850423 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.850596 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.850736 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.850902 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.851050 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.851202 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.851387 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.851519 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.851716 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.851827 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.852048 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.852205 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.852393 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.852482 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.852718 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.852842 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.853042 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.853243 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.853364 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.853586 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.853684 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.853901 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.854098 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.854383 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.854555 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.854686 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.854829 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.854999 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.855155 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.855305 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.855479 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.855624 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.855800 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.855928 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.856116 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.856229 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.856430 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.856542 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.856749 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.856846 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.857067 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.857156 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.857384 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.857495 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.857698 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.857807 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.858031 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.858126 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.858335 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.858425 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.858643 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.858765 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.858945 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.859046 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.859265 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.859355 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.859571 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.859674 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.859874 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.859972 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.860178 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.860268 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.860491 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.860725 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.860874 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.861045 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.861179 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.861371 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.861511 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.861672 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.861807 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.861991 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.862127 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.862308 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.862430 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.862611 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.862712 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.862913 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.863004 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.863219 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.863318 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.863502 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.863599 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.863810 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.863902 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.864132 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.864223 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.864440 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.864535 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.864747 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.864837 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.865048 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.865151 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.865354 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.865451 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.865678 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.865776 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.866550 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.866652 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.866652 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.866975 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.867077 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.867164 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.867257 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.867340 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.867428 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.867509 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.867750 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.867849 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.868080 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.868169 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.868388 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.868481 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.868713 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.868809 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.869028 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.869122 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.869329 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.869416 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.870167 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.870280 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.870477 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.870565 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.870867 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.870973 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.871105 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.871201 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.871410 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.871496 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.871716 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.871802 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.872020 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.872107 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.872327 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.872488 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.872629 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.872779 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.872951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.873088 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.873212 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.873302 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.873517 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.873621 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.873820 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.873910 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.874154 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.874244 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.874457 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.874557 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.874762 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.874849 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.875068 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.875203 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.875370 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.875540 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.875687 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.875776 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.875991 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.876080 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.876298 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.876395 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.876602 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.876689 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.876904 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.876991 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.877204 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.877301 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.877506 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.877595 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.877811 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.877899 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.878147 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.878250 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.878472 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.878564 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.878776 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.878863 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.879075 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.879164 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.879397 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.879484 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.879721 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.879809 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.880037 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.880126 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.880346 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.880433 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.880671 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.880771 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.880991 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.881080 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.881308 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.881522 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.881611 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.881858 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.881948 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.882206 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.882311 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.882541 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.882629 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.882873 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.882969 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.883183 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.883271 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.883490 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.883577 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.883790 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.883879 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.884092 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.884198 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.884393 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.884491 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.884700 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.884797 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.885007 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.885093 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.885855 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.885966 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.886194 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.886440 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.886539 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.886789 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.886876 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.887090 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.887180 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.887390 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.887478 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.887689 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.887792 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.887989 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.888079 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.888292 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.888380 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.888590 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.888688 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.888889 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.888978 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.889186 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.889275 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.889484 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.889581 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.889780 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.889869 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.890106 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.890199 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.890412 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.890503 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.890711 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.890800 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.891014 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.891161 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.891314 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.891404 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.891610 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.891698 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.891906 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.891995 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.892233 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.892332 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.892564 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.892654 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.892875 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.892964 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.893193 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.893328 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.893501 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.893599 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.893817 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.893920 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.894146 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.894235 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.894465 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.894554 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.894782 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.894881 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.895090 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.895178 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.895395 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.895484 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.895723 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.895820 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.896027 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.896115 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.896334 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.896423 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.896641 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.896737 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.896945 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.897033 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.897248 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.897343 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.897556 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.897645 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.897877 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.897966 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.898222 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.898311 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.898524 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.898615 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.898833 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.898920 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.899143 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.899230 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.899459 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.899547 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.899766 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.899852 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.900070 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.900166 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.900379 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.900467 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.900685 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.900772 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.901024 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.901189 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.901311 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.901398 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.901617 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.901712 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.901921 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.902080 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.902248 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.902334 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.902554 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.902648 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.902858 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.902946 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.903161 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.903247 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.903466 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.903566 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.903772 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.903863 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.904082 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.904169 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.904384 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.904478 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.904685 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.904783 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.904989 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.905078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.905293 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.905381 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.905597 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.905697 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.905927 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.906035 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.906283 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.906384 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.906600 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.906697 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.906907 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.906994 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.907207 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.907304 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.907449 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 04:13:08.907538 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.907827 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.908150 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.908473 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.908787 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.909096 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.909434 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.909748 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.910082 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.910396 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.910706 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.911020 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.911333 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.911660 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.911989 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.912299 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.912625 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.912944 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.913265 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.913582 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.913895 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.914254 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.914568 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.914880 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.915190 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.915503 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.915817 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.916133 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.916448 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.916791 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.917105 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.917420 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.917749 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.918098 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.918411 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.918738 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.919064 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.919418 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.919731 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.920073 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.920401 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.920715 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.921028 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.921334 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:13:08.921577 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 04:13:09.061327 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO dbcounter [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] Registered counter for database nova_api Jul 27 04:13:09.075440 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Registered counter for database nova_api Jul 27 04:13:09.084445 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG oslo_db.sqlalchemy.engines [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:13:09.091727 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writer thread running {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:13:09.096467 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:13:09.102876 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:13:09.146817 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.context [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),830f8882-12e3-4311-ad7f-da8e13e981d2(cell1) {{(pid=103224) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 04:13:09.151661 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:13:09.153336 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:13:09.154139 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:13:09.156099 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:13:09.158119 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO dbcounter [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] Registered counter for database nova_cell0 Jul 27 04:13:09.161073 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.context [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),830f8882-12e3-4311-ad7f-da8e13e981d2(cell1) {{(pid=103225) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 04:13:09.163989 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO dbcounter [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] Registered counter for database nova_cell1 Jul 27 04:13:09.169145 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:13:09.171116 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:13:09.171951 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:13:09.172826 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG oslo_db.sqlalchemy.engines [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:13:09.174008 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:13:09.174585 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG oslo_db.sqlalchemy.engines [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:13:09.176040 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Registered counter for database nova_cell0 Jul 27 04:13:09.180027 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writer thread running {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:13:09.181526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Registered counter for database nova_cell1 Jul 27 04:13:09.185313 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writer thread running {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:13:09.188601 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:13:09.192145 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:13:09.195480 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:13:09.328858 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO dbcounter [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] Registered counter for database nova_cell0 Jul 27 04:13:09.336221 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:13:09.337696 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG oslo_db.sqlalchemy.engines [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:13:09.342853 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writer thread running {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:13:09.346235 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Registered counter for database nova_cell0 Jul 27 04:13:09.354784 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:13:09.359328 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:13:09.677376 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 04:13:09.685246 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 04:13:09.685391 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: WARNING keystonemiddleware.auth_token [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 04:13:09.692816 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: WARNING keystonemiddleware.auth_token [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 04:13:10.027128 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 04:13:10.033109 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 04:13:10.036728 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: WARNING keystonemiddleware.auth_token [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 04:13:10.038317 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f4e941f9c0 pid: 103225 (default app) Jul 27 04:13:10.040353 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:13:10.042081 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001707 Jul 27 04:13:10.042673 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Wed Jul 27 04:13:10 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:13:10.043195 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: WARNING keystonemiddleware.auth_token [None req-fd12a0b9-1f3e-4b34-a82a-43c99a6f4b77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 04:13:10.048398 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f4e941f9c0 pid: 103224 (default app) Jul 27 04:14:25.856763 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:25.857742 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 27 04:14:25.858356 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:14:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:14:25.875938 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=3 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:25.877283 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_cell0:SELECT=3 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:25.878713 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_cell1:SELECT=3 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:25.879739 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:26.770195 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-37cdaa26-fe66-43e1-b198-085bffcc2315 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:26.806320 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-37cdaa26-fe66-43e1-b198-085bffcc2315 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.940620 Jul 27 04:14:26.807219 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Wed Jul 27 04:14:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:14:29.036460 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:29.037416 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-39e5a6bc-69ed-4daf-9f8d-a20b0c3705d6 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 Jul 27 04:14:29.043576 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:14:29 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:14:29.503401 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-a5bfc0b1-25d2-41d3-b292-a2f09254deeb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "name": "cirros256"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:29.524060 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:14:29.524060 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 27 04:14:29.555063 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-a5bfc0b1-25d2-41d3-b292-a2f09254deeb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.510716 Jul 27 04:14:29.556527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 27 04:14:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 04:14:29.570203 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=3 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:29.571552 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell0:SELECT=3 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:29.572576 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell1:SELECT=3 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:29.573314 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell0:SELECT=3 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:29.784900 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-73260f4c-de34-4852-b41b-b7cba73cc9cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:29.789463 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:14:29.789463 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 27 04:14:29.863264 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-73260f4c-de34-4852-b41b-b7cba73cc9cb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298491 Jul 27 04:14:29.864105 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jul 27 04:14:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:14:32.104368 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-a5bfc0b1-25d2-41d3-b292-a2f09254deeb admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:32.105448 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-a5bfc0b1-25d2-41d3-b292-a2f09254deeb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 27 04:14:32.105845 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:14:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:14:32.769034 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-409f82b1-afcb-490e-b54a-f84a878b0b89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:32.790360 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:14:32.790360 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 27 04:14:32.812509 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-409f82b1-afcb-490e-b54a-f84a878b0b89 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.700606 Jul 27 04:14:32.814056 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 27 04:14:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:14:32.826152 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-1617b98b-30fa-4c9c-b567-f3ef4229d057 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:32.828939 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:14:32.828939 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 27 04:14:32.865733 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-1617b98b-30fa-4c9c-b567-f3ef4229d057 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043391 Jul 27 04:14:32.874067 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jul 27 04:14:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:14:35.127099 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-409f82b1-afcb-490e-b54a-f84a878b0b89 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:35.128113 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-409f82b1-afcb-490e-b54a-f84a878b0b89 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 27 04:14:35.128514 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:14:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:14:35.528824 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-583dd97f-b68d-483a-a7d2-9da6c2477953 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:35.548236 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-583dd97f-b68d-483a-a7d2-9da6c2477953 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.413284 Jul 27 04:14:35.548704 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 27 04:14:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:14:35.560806 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-51f9c4d7-428e-43d0-b535-be98c208c53d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:35.584714 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-51f9c4d7-428e-43d0-b535-be98c208c53d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027541 Jul 27 04:14:35.585479 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jul 27 04:14:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:14:37.815231 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-583dd97f-b68d-483a-a7d2-9da6c2477953 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:37.816242 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-583dd97f-b68d-483a-a7d2-9da6c2477953 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001747 Jul 27 04:14:37.816703 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:14:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:14:38.250749 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-19985d98-2cf3-4e1d-9798-dfd1e837000c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:38.278496 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-19985d98-2cf3-4e1d-9798-dfd1e837000c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.454584 Jul 27 04:14:38.280189 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 27 04:14:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:14:38.295437 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-337282e8-e5fc-41ea-bd27-13fae5cdcf9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:38.332101 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-337282e8-e5fc-41ea-bd27-13fae5cdcf9a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041271 Jul 27 04:14:38.332864 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jul 27 04:14:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:14:40.611343 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-19985d98-2cf3-4e1d-9798-dfd1e837000c admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:40.612610 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-19985d98-2cf3-4e1d-9798-dfd1e837000c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 Jul 27 04:14:40.613270 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:14:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:14:41.046189 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-4c65ad85-32b8-4887-89e6-1f930e476735 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "id": "d4"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:41.066631 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-4c65ad85-32b8-4887-89e6-1f930e476735 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447079 Jul 27 04:14:41.067287 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 27 04:14:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:14:41.079359 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-af211635-e1f7-46c1-8d6f-c0a7006963ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:41.106177 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-af211635-e1f7-46c1-8d6f-c0a7006963ce admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030543 Jul 27 04:14:41.107138 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jul 27 04:14:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:14:43.551010 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-4c65ad85-32b8-4887-89e6-1f930e476735 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:43.552027 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-4c65ad85-32b8-4887-89e6-1f930e476735 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 27 04:14:43.552432 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:14:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:14:43.993122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-d173b243-628c-4962-bb44-a5f07a50c297 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:44.018506 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-d173b243-628c-4962-bb44-a5f07a50c297 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.459081 Jul 27 04:14:44.019096 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Wed Jul 27 04:14:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:14:46.499211 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-4c65ad85-32b8-4887-89e6-1f930e476735 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:46.500617 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-4c65ad85-32b8-4887-89e6-1f930e476735 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Jul 27 04:14:46.501108 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:14:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:14:46.925647 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-4fa5c256-d23a-42bf-896c-474903bd7646 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "id": "1"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:46.948021 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-4fa5c256-d23a-42bf-896c-474903bd7646 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.440280 Jul 27 04:14:46.948318 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 27 04:14:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:14:46.961081 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-e2d55f77-1d21-4b78-9bca-452fc7ec6bbd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:46.988582 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-e2d55f77-1d21-4b78-9bca-452fc7ec6bbd admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032240 Jul 27 04:14:46.989253 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jul 27 04:14:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:14:49.350031 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-4fa5c256-d23a-42bf-896c-474903bd7646 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:49.351040 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-4fa5c256-d23a-42bf-896c-474903bd7646 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 27 04:14:49.351437 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:14:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:14:49.752206 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-8d67ee80-96bc-4c08-9b6d-02167c051cd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:49.771558 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-8d67ee80-96bc-4c08-9b6d-02167c051cd5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.413675 Jul 27 04:14:49.772211 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 27 04:14:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:14:49.784718 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-a10efde7-ed57-49d3-b169-e5bc453f31c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:49.809141 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-a10efde7-ed57-49d3-b169-e5bc453f31c6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028176 Jul 27 04:14:49.809740 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jul 27 04:14:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:14:52.016168 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-8d67ee80-96bc-4c08-9b6d-02167c051cd5 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:52.017323 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-8d67ee80-96bc-4c08-9b6d-02167c051cd5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jul 27 04:14:52.017722 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:14:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:14:52.414150 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-4ce4a74e-b15d-4d5e-857e-c18711535901 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "ram": 4096, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:52.433523 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-4ce4a74e-b15d-4d5e-857e-c18711535901 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.409944 Jul 27 04:14:52.441190 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 27 04:14:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:14:52.450872 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-2417fc27-023a-4bc5-8eb8-f1016a111fce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:52.478982 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-2417fc27-023a-4bc5-8eb8-f1016a111fce admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031307 Jul 27 04:14:52.479830 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jul 27 04:14:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:14:54.751703 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-4ce4a74e-b15d-4d5e-857e-c18711535901 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:54.752707 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-4ce4a74e-b15d-4d5e-857e-c18711535901 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 27 04:14:54.758871 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:14:54 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:14:55.190226 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-11297855-84bb-4fe9-af44-86852bd1f55d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:55.210852 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-11297855-84bb-4fe9-af44-86852bd1f55d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450530 Jul 27 04:14:55.212495 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 27 04:14:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 04:14:55.224698 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-bfbbb642-2af2-4db9-8df3-cb6c57b3ae1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:55.259315 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-bfbbb642-2af2-4db9-8df3-cb6c57b3ae1e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039392 Jul 27 04:14:55.260218 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jul 27 04:14:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:14:57.519039 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-11297855-84bb-4fe9-af44-86852bd1f55d admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:14:57.520059 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-11297855-84bb-4fe9-af44-86852bd1f55d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jul 27 04:14:57.520453 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:14:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:14:58.110018 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-4f2b27b5-44a2-4a56-bb7f-9eb70bf43f10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:58.135213 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-4f2b27b5-44a2-4a56-bb7f-9eb70bf43f10 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.608203 Jul 27 04:14:58.135799 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jul 27 04:14:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:14:58.147808 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-14177623-9e51-4afc-8c0c-83d44b0838f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:14:58.154488 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:58.177688 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-14177623-9e51-4afc-8c0c-83d44b0838f5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033557 Jul 27 04:14:58.186556 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jul 27 04:14:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:15:17.509944 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-4f2b27b5-44a2-4a56-bb7f-9eb70bf43f10 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:17.511035 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-4f2b27b5-44a2-4a56-bb7f-9eb70bf43f10 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 27 04:15:17.511423 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:15:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:15:17.521552 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:15:17.902663 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-4a590b30-ecb1-41b2-b798-3d05bd1c2444 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:17.920140 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-4a590b30-ecb1-41b2-b798-3d05bd1c2444 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402994 Jul 27 04:15:17.920666 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Wed Jul 27 04:15:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:15:18.985891 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-4f2b27b5-44a2-4a56-bb7f-9eb70bf43f10 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:18.986927 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-4f2b27b5-44a2-4a56-bb7f-9eb70bf43f10 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 27 04:15:18.987325 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 27 04:15:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:15:19.509115 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-da20f132-15a2-49db-a8cf-e613309baeda admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:19.514636 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.wsgi [None req-da20f132-15a2-49db-a8cf-e613309baeda admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-da20f132-15a2-49db-a8cf-e613309baeda admin admin] Request method failure captured: Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Accept: application/json Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Accept-Encoding: gzip, deflate Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Connection: keep-alive Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Content-Length: 0 Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Host: 10.222.0.46 Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Openstack-Api-Version: compute 2.90 Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Openstack-System-Scope: None Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: User-Agent: python-novaclient Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Auth-Token: gAAAAABi4LvWBRYq1LKcujzAamK0CkxMnH_u94dIB964zNzT6kz0Vq9tqE6iz4jjDM3J4KDVytQ6rae2dP_4aI_5D5wV6XOdDdKZ1BBmzvUQbe19JMiS8-eP6Tay27vXrBPzhIyJ_g1pwoTPJgb_Gm8L7qV4RAAhELC165WIFiKq4dMrsAcO1Ss Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Domain-Id: None Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Domain-Name: None Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Identity-Status: Confirmed Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Is-Admin-Project: True Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Project-Domain-Id: default Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Project-Domain-Name: Default Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Project-Id: 5672fa915b944f15a9f6ebcb29dba655 Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Project-Name: admin Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Role: admin,reader,member Jul 27 04:15:19.517837 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Roles: admin,reader,member Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Tenant: admin Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Tenant-Id: 5672fa915b944f15a9f6ebcb29dba655 Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Tenant-Name: admin Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User: admin Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User-Domain-Id: default Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User-Domain-Name: Default Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User-Id: 32924f9a30fb4e7b835bb29d116319d9 Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User-Name: admin Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: method: > Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: exception: Flavor 42 could not be found. Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: action_args: {'id': '42'} Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:15:19.519504 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:15:19.520563 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:19.521951 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-da20f132-15a2-49db-a8cf-e613309baeda admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:15:19.523485 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-da20f132-15a2-49db-a8cf-e613309baeda admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394720 Jul 27 04:15:19.523485 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Jul 27 04:15:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 04:15:19.528728 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-be4b0ad1-87f0-4254-8830-ee616ed29ee4 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:19.532859 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:15:19.551746 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-be4b0ad1-87f0-4254-8830-ee616ed29ee4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026556 Jul 27 04:15:19.552272 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jul 27 04:15:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:15:19.562340 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-7be4cb8b-7a1b-4e70-8190-7416f2cafe6d admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:19.586664 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-7be4cb8b-7a1b-4e70-8190-7416f2cafe6d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027840 Jul 27 04:15:19.587192 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jul 27 04:15:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:15:19.597076 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-d92dcf39-7f2e-4bde-a2c7-0487c3e1fd64 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:19.603404 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.wsgi [None req-d92dcf39-7f2e-4bde-a2c7-0487c3e1fd64 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-d92dcf39-7f2e-4bde-a2c7-0487c3e1fd64 admin admin] Request method failure captured: Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Accept: application/json Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Accept-Encoding: gzip, deflate Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Connection: keep-alive Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Content-Length: 0 Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Host: 10.222.0.46 Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Openstack-Api-Version: compute 2.90 Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Openstack-System-Scope: None Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: User-Agent: python-novaclient Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Auth-Token: gAAAAABi4LvWBRYq1LKcujzAamK0CkxMnH_u94dIB964zNzT6kz0Vq9tqE6iz4jjDM3J4KDVytQ6rae2dP_4aI_5D5wV6XOdDdKZ1BBmzvUQbe19JMiS8-eP6Tay27vXrBPzhIyJ_g1pwoTPJgb_Gm8L7qV4RAAhELC165WIFiKq4dMrsAcO1Ss Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Domain-Id: None Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Domain-Name: None Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Identity-Status: Confirmed Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Is-Admin-Project: True Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Project-Domain-Id: default Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Project-Domain-Name: Default Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Project-Id: 5672fa915b944f15a9f6ebcb29dba655 Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Project-Name: admin Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Role: admin,reader,member Jul 27 04:15:19.606586 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Roles: admin,reader,member Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Tenant: admin Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Tenant-Id: 5672fa915b944f15a9f6ebcb29dba655 Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Tenant-Name: admin Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User: admin Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User-Domain-Id: default Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User-Domain-Name: Default Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User-Id: 32924f9a30fb4e7b835bb29d116319d9 Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User-Name: admin Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: method: > Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: exception: Flavor 42 could not be found. Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: action_args: {'id': '42'} Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:15:19.608122 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:15:19.609131 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:19.610526 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-d92dcf39-7f2e-4bde-a2c7-0487c3e1fd64 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:15:19.611764 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-d92dcf39-7f2e-4bde-a2c7-0487c3e1fd64 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015051 Jul 27 04:15:19.611764 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Jul 27 04:15:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 04:15:20.603217 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-7be4cb8b-7a1b-4e70-8190-7416f2cafe6d admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:20.604222 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-7be4cb8b-7a1b-4e70-8190-7416f2cafe6d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002499 Jul 27 04:15:20.604615 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 27 04:15:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:15:21.121512 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-0896f83a-b3dc-4b47-a8f2-7247f877b4b0 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:21.127062 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.wsgi [None req-0896f83a-b3dc-4b47-a8f2-7247f877b4b0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-0896f83a-b3dc-4b47-a8f2-7247f877b4b0 admin admin] Request method failure captured: Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Accept: application/json Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Accept-Encoding: gzip, deflate Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Connection: keep-alive Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Content-Length: 0 Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Host: 10.222.0.46 Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Openstack-Api-Version: compute 2.90 Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Openstack-System-Scope: None Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: User-Agent: python-novaclient Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Auth-Token: gAAAAABi4LvYb5emPEYUrphudfrS39buCL9GAwzyua59LSXQYr-mpvLioS3nAErkb8iIKWkUsKaAEM0lr3rkK1Rinuqon2QNOfcnJoMlqhUKvFcskCLSyscZF4HABvbOzJugRltYXoflIh-mVtQloKhFEruua05KkTzm7TTrJiPgQ0XN3IBeahw Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Domain-Id: None Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Domain-Name: None Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Identity-Status: Confirmed Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Is-Admin-Project: True Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Project-Domain-Id: default Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Project-Domain-Name: Default Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Project-Id: 5672fa915b944f15a9f6ebcb29dba655 Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Project-Name: admin Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Role: admin,reader,member Jul 27 04:15:21.128533 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Roles: admin,reader,member Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Tenant: admin Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Tenant-Id: 5672fa915b944f15a9f6ebcb29dba655 Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Tenant-Name: admin Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User: admin Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User-Domain-Id: default Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User-Domain-Name: Default Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User-Id: 32924f9a30fb4e7b835bb29d116319d9 Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User-Name: admin Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: method: > Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: exception: Flavor 84 could not be found. Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: action_args: {'id': '84'} Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:15:21.130053 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:15:21.131038 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:21.132319 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-0896f83a-b3dc-4b47-a8f2-7247f877b4b0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:15:21.133887 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-0896f83a-b3dc-4b47-a8f2-7247f877b4b0 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.384057 Jul 27 04:15:21.133887 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Jul 27 04:15:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 04:15:21.139554 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-9153e01e-f1b2-451a-8f92-439fd30490af admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:21.154787 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-9153e01e-f1b2-451a-8f92-439fd30490af admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018781 Jul 27 04:15:21.155323 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jul 27 04:15:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:15:21.165241 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-8d64622a-0098-45ec-bc47-f3f4e3c86eb5 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:21.181490 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-8d64622a-0098-45ec-bc47-f3f4e3c86eb5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020471 Jul 27 04:15:21.182014 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jul 27 04:15:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:15:21.191384 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-a982d915-172b-4fca-8442-41e33202f845 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:21.197008 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.wsgi [None req-a982d915-172b-4fca-8442-41e33202f845 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-a982d915-172b-4fca-8442-41e33202f845 admin admin] Request method failure captured: Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Accept: application/json Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Accept-Encoding: gzip, deflate Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Connection: keep-alive Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Content-Length: 0 Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Host: 10.222.0.46 Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Openstack-Api-Version: compute 2.90 Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Openstack-System-Scope: None Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: User-Agent: python-novaclient Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Auth-Token: gAAAAABi4LvYb5emPEYUrphudfrS39buCL9GAwzyua59LSXQYr-mpvLioS3nAErkb8iIKWkUsKaAEM0lr3rkK1Rinuqon2QNOfcnJoMlqhUKvFcskCLSyscZF4HABvbOzJugRltYXoflIh-mVtQloKhFEruua05KkTzm7TTrJiPgQ0XN3IBeahw Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Domain-Id: None Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Domain-Name: None Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Identity-Status: Confirmed Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Is-Admin-Project: True Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Project-Domain-Id: default Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Project-Domain-Name: Default Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Project-Id: 5672fa915b944f15a9f6ebcb29dba655 Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Project-Name: admin Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Role: admin,reader,member Jul 27 04:15:21.198527 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Roles: admin,reader,member Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Tenant: admin Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Tenant-Id: 5672fa915b944f15a9f6ebcb29dba655 Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Tenant-Name: admin Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User: admin Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User-Domain-Id: default Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User-Domain-Name: Default Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User-Id: 32924f9a30fb4e7b835bb29d116319d9 Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User-Name: admin Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: method: > Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: exception: Flavor 84 could not be found. Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: action_args: {'id': '84'} Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:15:21.200042 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:15:21.200873 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:21.202078 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-a982d915-172b-4fca-8442-41e33202f845 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:15:21.203272 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-a982d915-172b-4fca-8442-41e33202f845 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012235 Jul 27 04:15:21.203272 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Jul 27 04:15:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 04:15:22.163571 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-8d64622a-0098-45ec-bc47-f3f4e3c86eb5 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:22.165099 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-8d64622a-0098-45ec-bc47-f3f4e3c86eb5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 Jul 27 04:15:22.165492 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 27 04:15:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:15:22.685567 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-d4866c6b-19eb-492f-8bb3-91883b97396d admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:22.691524 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.wsgi [None req-d4866c6b-19eb-492f-8bb3-91883b97396d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-d4866c6b-19eb-492f-8bb3-91883b97396d admin admin] Request method failure captured: Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Accept: application/json Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Accept-Encoding: gzip, deflate Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Connection: keep-alive Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Content-Length: 0 Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Host: 10.222.0.46 Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Openstack-Api-Version: compute 2.90 Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Openstack-System-Scope: None Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: User-Agent: python-novaclient Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Auth-Token: gAAAAABi4LvavpUc8SVtkwzw0ZjY1O0KCXQBksoIffc6v7ePLz6raJkngH0ij5I52Eq0xHKiOIgZzz07AJ_our8i1u2i-SFrda0yqPW9mPmdd5Gk6Ny9N4QyHjPNP2tRndQuN-K41ulP4waNhzEH3jg3XjR9E36vvM6552c9R4uE30PDOa9PJ0E Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Domain-Id: None Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Domain-Name: None Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Identity-Status: Confirmed Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Is-Admin-Project: True Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Project-Domain-Id: default Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Project-Domain-Name: Default Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Project-Id: 5672fa915b944f15a9f6ebcb29dba655 Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Project-Name: admin Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Role: admin,reader,member Jul 27 04:15:22.693004 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Roles: admin,reader,member Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Tenant: admin Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Tenant-Id: 5672fa915b944f15a9f6ebcb29dba655 Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-Tenant-Name: admin Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User: admin Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User-Domain-Id: default Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User-Domain-Name: Default Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User-Id: 32924f9a30fb4e7b835bb29d116319d9 Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: X-User-Name: admin Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: method: > Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: exception: Flavor 451 could not be found. Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: action_args: {'id': '451'} Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:15:22.694521 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:15:22.695356 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 27 04:15:22.696740 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-d4866c6b-19eb-492f-8bb3-91883b97396d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:15:22.697763 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-d4866c6b-19eb-492f-8bb3-91883b97396d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389651 Jul 27 04:15:22.697763 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jul 27 04:15:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 04:15:22.703978 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-ef7327f9-1fc4-4925-9286-1aa1c932dbdf admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:22.719091 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-ef7327f9-1fc4-4925-9286-1aa1c932dbdf admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018684 Jul 27 04:15:22.719758 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jul 27 04:15:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:15:22.729594 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:22.744122 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018604 Jul 27 04:15:22.744632 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jul 27 04:15:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:15:22.753617 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-58357700-86c8-4af4-82cd-f09ae0e02498 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:22.759402 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.wsgi [None req-58357700-86c8-4af4-82cd-f09ae0e02498 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-58357700-86c8-4af4-82cd-f09ae0e02498 admin admin] Request method failure captured: Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Accept: application/json Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Accept-Encoding: gzip, deflate Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Connection: keep-alive Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Content-Length: 0 Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Host: 10.222.0.46 Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Openstack-Api-Version: compute 2.90 Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Openstack-System-Scope: None Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: User-Agent: python-novaclient Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Auth-Token: gAAAAABi4LvavpUc8SVtkwzw0ZjY1O0KCXQBksoIffc6v7ePLz6raJkngH0ij5I52Eq0xHKiOIgZzz07AJ_our8i1u2i-SFrda0yqPW9mPmdd5Gk6Ny9N4QyHjPNP2tRndQuN-K41ulP4waNhzEH3jg3XjR9E36vvM6552c9R4uE30PDOa9PJ0E Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Domain-Id: None Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Domain-Name: None Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Identity-Status: Confirmed Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Is-Admin-Project: True Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Project-Domain-Id: default Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Project-Domain-Name: Default Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Project-Id: 5672fa915b944f15a9f6ebcb29dba655 Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Project-Name: admin Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Role: admin,reader,member Jul 27 04:15:22.760868 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Roles: admin,reader,member Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5672fa915b944f15a9f6ebcb29dba655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Tenant: admin Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Tenant-Id: 5672fa915b944f15a9f6ebcb29dba655 Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-Tenant-Name: admin Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User: admin Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User-Domain-Id: default Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User-Domain-Name: Default Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User-Id: 32924f9a30fb4e7b835bb29d116319d9 Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: X-User-Name: admin Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: method: > Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: exception: Flavor 451 could not be found. Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: action_args: {'id': '451'} Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:15:22.762578 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:15:22.763455 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 27 04:15:22.764534 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-58357700-86c8-4af4-82cd-f09ae0e02498 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:15:22.765551 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-58357700-86c8-4af4-82cd-f09ae0e02498 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012097 Jul 27 04:15:22.765551 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jul 27 04:15:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 04:15:23.723579 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:23.724574 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 27 04:15:23.724972 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 27 04:15:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:15:24.244542 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-943f0ec4-9bc9-4f7e-aeb4-d4750c32df0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:15:24.263418 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-943f0ec4-9bc9-4f7e-aeb4-d4750c32df0f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.400115 Jul 27 04:15:24.263962 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Jul 27 04:15:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:15:25.238126 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:25.239134 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 27 04:15:25.239528 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 27 04:15:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:15:25.765092 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-a940f4d9-f898-44d1-be6e-23012fddaa74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:15:25.783941 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-a940f4d9-f898-44d1-be6e-23012fddaa74 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.405367 Jul 27 04:15:25.784490 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Jul 27 04:15:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:15:26.771490 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:26.772493 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 27 04:15:26.772882 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 27 04:15:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:15:27.302754 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-3439a63c-7014-45a7-8bd9-9275903c3da0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:15:27.321946 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-3439a63c-7014-45a7-8bd9-9275903c3da0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.403212 Jul 27 04:15:27.322540 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Jul 27 04:15:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:15:28.292754 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:28.293758 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 27 04:15:28.294183 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 27 04:15:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:15:28.830405 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-6a06caaf-da1f-4bf3-8c32-7a47554c9177 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:15:28.849080 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-6a06caaf-da1f-4bf3-8c32-7a47554c9177 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.417280 Jul 27 04:15:28.849627 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Jul 27 04:15:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:15:29.826289 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:29.827293 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 27 04:15:29.827681 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 27 04:15:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:15:30.346856 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-ea19d30e-ac81-44c3-a9c4-0e4947f3ea82 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:15:30.368224 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-ea19d30e-ac81-44c3-a9c4-0e4947f3ea82 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400115 Jul 27 04:15:30.368750 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Wed Jul 27 04:15:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:16:21.902345 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:16:21.903373 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-cae52044-df29-4026-9696-18aa29d14b84 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 27 04:16:21.903760 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jul 27 04:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:16:21.914850 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:16:22.295339 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-1bf50ff1-7c3c-4292-b6b8-f0132548345a admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:16:22.316425 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-1bf50ff1-7c3c-4292-b6b8-f0132548345a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406552 Jul 27 04:16:22.316919 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Wed Jul 27 04:16:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:16:22.340089 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-9415ae45-f436-49cd-8eea-ac386bba4ab7 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:16:22.343514 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=14 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:16:22.349089 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-9415ae45-f436-49cd-8eea-ac386bba4ab7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012567 Jul 27 04:16:22.349631 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Wed Jul 27 04:16:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:16:22.361520 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-68c9c797-3508-461b-ad9e-364c15cae4e2 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:16:22.369675 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-68c9c797-3508-461b-ad9e-364c15cae4e2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011689 Jul 27 04:16:22.370216 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Wed Jul 27 04:16:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:16:22.381100 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-8b8a8e65-f761-482b-afdf-cf4ec5eb4efe admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:16:22.388813 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-8b8a8e65-f761-482b-afdf-cf4ec5eb4efe admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011198 Jul 27 04:16:22.389317 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Wed Jul 27 04:16:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:16:22.400864 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-f07fd4a3-21ff-4c7e-8c74-50ca1a01ae19 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:16:22.408279 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-f07fd4a3-21ff-4c7e-8c74-50ca1a01ae19 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011436 Jul 27 04:16:22.408781 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Wed Jul 27 04:16:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:19:40.049831 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-8b8a8e65-f761-482b-afdf-cf4ec5eb4efe admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:19:40.050863 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-8b8a8e65-f761-482b-afdf-cf4ec5eb4efe admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 27 04:19:40.051247 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 27 04:19:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:19:40.189829 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=6 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:40.348632 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-b2fda890-aff6-484e-91bf-b828a70484fd admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:19:40.351123 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:19:40.351123 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 27 04:19:40.352400 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-b2fda890-aff6-484e-91bf-b828a70484fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:19:40.352838 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-b2fda890-aff6-484e-91bf-b828a70484fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:19:40.353620 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-b2fda890-aff6-484e-91bf-b828a70484fd admin admin] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:19:40.354074 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-b2fda890-aff6-484e-91bf-b828a70484fd admin admin] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:19:40.388207 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-b2fda890-aff6-484e-91bf-b828a70484fd admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199863 Jul 27 04:19:40.388769 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jul 27 04:19:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:19:41.242794 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-8b8a8e65-f761-482b-afdf-cf4ec5eb4efe admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:19:41.243878 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-8b8a8e65-f761-482b-afdf-cf4ec5eb4efe admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Jul 27 04:19:41.244266 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 27 04:19:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:19:41.435907 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-d32deda0-ab8c-4937-bb02-b7ae378b213d admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:19:41.438293 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:19:41.438293 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 27 04:19:41.439468 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-d32deda0-ab8c-4937-bb02-b7ae378b213d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:19:41.439895 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-d32deda0-ab8c-4937-bb02-b7ae378b213d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:19:41.440692 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-d32deda0-ab8c-4937-bb02-b7ae378b213d admin admin] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:19:41.441107 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-d32deda0-ab8c-4937-bb02-b7ae378b213d admin admin] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:19:41.465211 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-d32deda0-ab8c-4937-bb02-b7ae378b213d admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078765 Jul 27 04:19:41.465211 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jul 27 04:19:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:19:52.703119 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-8b8a8e65-f761-482b-afdf-cf4ec5eb4efe admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:19:52.704126 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-8b8a8e65-f761-482b-afdf-cf4ec5eb4efe admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 27 04:19:52.704544 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 27 04:19:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:19:52.848883 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell0:SELECT=4 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:52.849596 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell1:SELECT=4 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:52.850473 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=8 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:52.898245 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-39df0dc8-1835-4806-8a28-375c432a8a08 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:19:52.900600 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:19:52.900600 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 27 04:19:52.901795 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-39df0dc8-1835-4806-8a28-375c432a8a08 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:19:52.902786 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-39df0dc8-1835-4806-8a28-375c432a8a08 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:19:52.903764 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-39df0dc8-1835-4806-8a28-375c432a8a08 admin admin] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:19:52.904194 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-39df0dc8-1835-4806-8a28-375c432a8a08 admin admin] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:19:52.929386 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-39df0dc8-1835-4806-8a28-375c432a8a08 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084573 Jul 27 04:19:52.929942 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jul 27 04:19:52 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:19:53.753237 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-8b8a8e65-f761-482b-afdf-cf4ec5eb4efe admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:19:53.754268 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-8b8a8e65-f761-482b-afdf-cf4ec5eb4efe admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 27 04:19:53.754663 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jul 27 04:19:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:19:53.946595 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-cd88ba94-9d0a-4543-b02f-8881bc3e8573 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:19:53.948920 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:19:53.948920 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 27 04:19:53.950767 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-cd88ba94-9d0a-4543-b02f-8881bc3e8573 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:19:53.951195 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-cd88ba94-9d0a-4543-b02f-8881bc3e8573 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:19:53.951963 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-cd88ba94-9d0a-4543-b02f-8881bc3e8573 admin admin] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:19:53.952379 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-cd88ba94-9d0a-4543-b02f-8881bc3e8573 admin admin] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:19:53.973420 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-cd88ba94-9d0a-4543-b02f-8881bc3e8573 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078107 Jul 27 04:19:53.973897 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jul 27 04:19:53 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:20:48.798662 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: Wed Jul 27 04:20:48 2022 - graceful shutdown triggered... Jul 27 04:20:48.798991 dv-cinder-850989-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 27 04:20:48.799614 dv-cinder-850989-2-iscsi devstack@n-api.service[103224]: Gracefully killing worker 1 (pid: 103224)... Jul 27 04:20:48.800062 dv-cinder-850989-2-iscsi devstack@n-api.service[103225]: Gracefully killing worker 2 (pid: 103225)... Jul 27 04:20:49.799511 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: worker 1 buried after 1 seconds Jul 27 04:20:49.799511 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: worker 2 buried after 1 seconds Jul 27 04:20:49.799511 dv-cinder-850989-2-iscsi devstack@n-api.service[103223]: goodbye to uWSGI. Jul 27 04:20:49.801225 dv-cinder-850989-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 27 04:20:49.801764 dv-cinder-850989-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 27 04:20:49.804632 dv-cinder-850989-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 04:20:49.814056 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 04:20:49.816657 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 04:20:49 2022] *** Jul 27 04:20:49.816657 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 04:20:49.816657 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 04:20:49.816657 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: nodename: dv-cinder-850989-2-iscsi Jul 27 04:20:49.816657 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: machine: x86_64 Jul 27 04:20:49.816657 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: clock source: unix Jul 27 04:20:49.816657 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: pcre jit disabled Jul 27 04:20:49.816657 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: detected number of CPU cores: 4 Jul 27 04:20:49.816657 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: current working directory: / Jul 27 04:20:49.816657 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: detected binary path: /usr/bin/uwsgi-core Jul 27 04:20:49.816657 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: your processes number limit is 47680 Jul 27 04:20:49.816657 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: your memory page size is 4096 bytes Jul 27 04:20:49.817458 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: detected max file descriptor number: 2048 Jul 27 04:20:49.817458 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: lock engine: pthread robust mutexes Jul 27 04:20:49.817458 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: thunder lock: enabled Jul 27 04:20:49.817458 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 04:20:49.817458 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 04:20:49.860489 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: Python main interpreter initialized at 0x55f3d23319c0 Jul 27 04:20:49.860489 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: python threads support enabled Jul 27 04:20:49.860489 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: your server socket listen backlog is limited to 100 connections Jul 27 04:20:49.860489 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: your mercy for graceful operations on workers is 90 seconds Jul 27 04:20:49.860929 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 04:20:49.860929 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: *** Operational MODE: preforking *** Jul 27 04:20:49.861214 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: *** uWSGI is running in multiple interpreter mode *** Jul 27 04:20:49.861214 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: spawned uWSGI master process (pid: 117722) Jul 27 04:20:49.861425 dv-cinder-850989-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 04:20:49.862032 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: spawned uWSGI worker 1 (pid: 117739, cores: 1) Jul 27 04:20:49.862591 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: spawned uWSGI worker 2 (pid: 117740, cores: 1) Jul 27 04:20:49.863010 dv-cinder-850989-2-iscsi devstack@n-api.service[117722]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 04:20:50.526424 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 04:20:50.534028 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 04:20:51.702280 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 04:20:51.702280 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: from cryptography.utils import int_from_bytes Jul 27 04:20:51.702902 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 04:20:51.702902 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: from cryptography.utils import int_from_bytes Jul 27 04:20:51.708873 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 04:20:51.708873 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: from cryptography.utils import int_from_bytes Jul 27 04:20:51.709303 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 04:20:51.709303 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: from cryptography.utils import int_from_bytes Jul 27 04:20:54.161428 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 04:20:54.162133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 04:20:54.162271 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 04:20:54.162639 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 04:20:54.162900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 04:20:54.163293 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.163621 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.163941 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.164256 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.164594 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.164905 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.165226 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.165544 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.165871 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.166158 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.166472 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.166834 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850989-2-iscsi {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.167122 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.167652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.167965 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.168284 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.168637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.169014 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.169323 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.169826 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.171031 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.171031 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.171031 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.171279 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.171527 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.171836 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.172158 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.172465 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.172792 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.173096 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.173496 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850989-2-iscsi {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.173812 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.174582 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.174896 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.175314 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.175623 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.175935 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.176246 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.176569 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.176877 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.177209 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.177535 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.177852 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.178023 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 04:20:54.178471 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.178618 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 04:20:54.178751 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.178881 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.179054 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 04:20:54.179188 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.179347 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 04:20:54.179481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 04:20:54.179618 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.179757 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.179902 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.180150 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.180299 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.180440 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.180582 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.180729 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.180893 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.181036 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.181177 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.181310 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.181451 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.181738 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.181886 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.182047 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.182047 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.182310 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.182450 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.182590 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.182590 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.182838 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.182989 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.183623 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.183769 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850989-2-iscsi {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.183903 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.184134 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.184275 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.184495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.184734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.184840 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.185053 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.185152 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.185377 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.185469 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.185688 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.185795 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.186027 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.186121 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.186340 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.186455 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.186662 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.186846 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.186970 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.187158 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.187292 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.187465 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.187706 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.187805 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.187958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.188105 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.188266 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.188420 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.188608 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.188730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.188927 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.189037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.189238 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.189351 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.189556 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.189657 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.189880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.189991 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.190257 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.190378 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850989-2-iscsi {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.190564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.190655 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.190873 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.190986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.191196 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.191308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.191518 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.191660 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.191823 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.191975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.192080 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.192287 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.192388 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.192612 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.192710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.192937 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.193038 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.193245 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.193338 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.193548 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.193637 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.194139 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.194244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.194443 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.194544 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.194751 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.194842 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.195061 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.195150 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.195365 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.195461 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.195669 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.195759 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.195975 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.196064 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.196277 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.196383 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.196587 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.196696 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.196864 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.196954 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.197173 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.197263 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.197489 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.197588 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.197810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.197899 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.198142 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.198245 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.198406 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.198511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.198676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.199335 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.199634 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.199750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.199974 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.200203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.200325 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.200525 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.200629 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.200837 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.200928 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.201148 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.201263 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.201456 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.201575 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.201764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.201876 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.202094 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.202195 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.202402 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.202501 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.202710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.202809 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.203008 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.203108 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.203315 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.203422 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.203630 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.203731 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.203936 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.204044 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.204241 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.204348 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.204535 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.204631 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.204840 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.204948 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.205148 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.205254 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.205450 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.205549 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.205753 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.205867 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.206095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.206197 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.206398 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.206512 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.206718 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.206827 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.207038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.207146 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.207344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.207501 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.207677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.207849 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.208584 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.208743 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.208898 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.209055 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.209055 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.209352 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.209506 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.209689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.209838 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.210022 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.210195 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.210365 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.210513 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.210667 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.210822 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.210976 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.211201 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.211357 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.211636 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.211803 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.211963 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.212120 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.212269 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.212426 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.212581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.212734 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.212889 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.213048 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.213206 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.213353 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.213507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.213661 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.213815 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.213993 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.214157 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.214157 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.214500 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.214649 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.214795 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.214961 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.215116 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.215272 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.215419 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.215573 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.215733 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.215733 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.216022 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.216175 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.216322 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.216485 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.216646 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.216803 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.216950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.217112 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.217260 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.217411 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.217565 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.217721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.217868 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.218044 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.218204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.218362 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.218517 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.218669 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.218825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.218983 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.219131 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.219284 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.219438 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.219585 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.219737 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.219899 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.220054 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.220208 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.220372 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.220526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.220683 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.220837 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.220992 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.221146 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.221294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.221439 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.221599 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.221746 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.221890 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.222071 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.222248 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.222487 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.222653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.222824 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.222974 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.222974 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.223257 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.223404 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.223559 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.223715 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.223870 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.224025 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.224172 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.224318 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.224474 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.224634 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.224788 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.224944 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.225102 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.225256 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:20:54.225410 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.225410 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.225706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.225853 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.226071 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.226226 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.226382 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.226547 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.226703 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.226856 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.227003 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.227151 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.227307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.227461 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.227608 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.227762 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.227915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.228069 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.228230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.228394 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.228550 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.228704 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.228858 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.229018 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.229174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.229321 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.229467 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.229628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.230307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.230483 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.230634 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.230790 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.230957 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.231113 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.231268 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.231431 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.231586 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.231732 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.231886 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.232033 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.232179 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.232337 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.232337 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.232618 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.232772 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.232930 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.233089 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.233243 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.233396 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.233552 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.233698 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.233851 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.234065 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.234228 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.234376 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.234531 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.234679 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.234835 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.235005 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.235161 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.235308 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.235453 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.235607 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.235754 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.235908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.236055 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.236211 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.236358 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.236503 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.236663 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.236823 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.236976 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.237130 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.237284 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.237438 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.237666 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.237816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.237816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.238138 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.238297 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.238445 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.238600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.238755 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.238912 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.239067 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.239220 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.239367 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.239526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.239680 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.239839 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.239992 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.240147 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.240307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.240460 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.240614 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.240770 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.240917 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.241062 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.241217 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.241363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.241509 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.241653 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.241807 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.242038 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.242206 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.242362 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.242517 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.242517 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.242815 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.242963 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.243122 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.243276 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.243430 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.243576 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.243721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.243865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.244020 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.244020 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.244305 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.244451 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.244803 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.244983 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.245165 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.245323 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.245497 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.245497 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.246367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.246536 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.246685 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.246873 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.246873 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.247183 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.247331 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.247485 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.247644 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.247813 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.247981 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.248138 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.248285 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.248444 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.248598 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.248761 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.248915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.249062 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.249218 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.249365 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.249510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.249665 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.249819 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.249966 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.250150 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.250337 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.250492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.250638 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.250784 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.250934 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.251098 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.251267 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.251418 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.251576 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.251761 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.251918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.252077 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.252236 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.252455 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.252617 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.252803 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.252966 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.253144 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.253303 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.253451 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.253597 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.253754 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.253914 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.254123 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.254278 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.254426 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.254570 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.254715 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.254875 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.255034 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.255180 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.255325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.255325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.255641 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.255808 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.255954 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.256108 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.256260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.256414 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.256574 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.256727 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.256881 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.257034 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.257187 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.257340 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.257503 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.257709 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.257882 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.258072 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.258231 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.258383 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.258544 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.258705 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.258864 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.259017 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.259176 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.259336 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.259498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.259498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.259854 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.260008 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.260160 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.260322 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.260475 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.260627 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.260786 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.260946 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.261106 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.261902 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.262045 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.262168 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.262263 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.262345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.262432 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.262526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.262620 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.262712 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.262804 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.262894 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.262983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.263076 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.263159 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.263241 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.263332 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.263422 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.263506 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.263596 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.263596 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.263756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.263838 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.263919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.264009 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.264093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.264174 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.264264 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.264347 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.264430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.264529 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.264614 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.264695 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.264806 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.264879 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.264969 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.265142 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.265327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.265486 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.265639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.265840 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.266024 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.266273 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.266439 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.266613 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.266786 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.266941 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.267109 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.267263 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.267415 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.267566 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.267727 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.267888 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.268053 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.268207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.268359 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.268511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.268676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.268836 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.269002 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.269157 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.269317 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.269470 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.269622 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.269780 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.269944 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.270122 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.270276 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.270439 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.270603 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.270764 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.270917 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.270917 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.271214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.271483 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.271672 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.271979 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.272164 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.272348 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.272514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.272676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.272830 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.273004 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.273164 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.273333 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.273486 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.273638 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.273877 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.274100 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.274261 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.274415 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.274581 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.274743 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.274931 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.275087 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.275250 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.275411 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.275573 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.275727 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.275879 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.276031 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.276191 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.276345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.276506 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.276660 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.277014 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.277218 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.277389 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.277555 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.277709 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.277861 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.278064 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.278235 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.278396 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.278565 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.278727 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.278727 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.279033 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.279195 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.279356 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.279530 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.279686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.279837 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.279997 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.280157 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.280312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.280478 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.280641 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.280794 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.280955 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.281116 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.281279 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.281440 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.281605 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.281759 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.281911 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.282097 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.282263 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.282424 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.282580 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.282733 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.282893 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.283047 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.283209 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.283363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.283515 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.283678 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.283838 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.284004 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.284159 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.284323 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.284477 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.284628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.284780 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.284948 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.285102 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.285255 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.285413 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.285585 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.285740 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.285902 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.286080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.286252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.286414 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.286568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.286728 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.286898 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.287061 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.287222 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.287383 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.287538 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.287714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.287877 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.288040 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.288193 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.288353 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.288520 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.288520 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.288827 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.288987 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.289141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.289302 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.289456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.289623 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.289811 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.290022 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.290022 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.290333 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.290487 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.290692 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.290848 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.291001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.291161 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.291315 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.291476 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.291637 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.291790 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.291962 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.292126 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.292288 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.292476 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.292642 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.292804 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.292958 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.293188 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.293456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.293612 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.293766 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.293925 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.294112 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.294284 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.294439 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.294600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.294761 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.294915 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.295077 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.295240 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.295240 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.295541 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.295693 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.295845 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.296011 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.296176 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.296335 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.296520 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.296672 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.296839 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.297076 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.297233 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.297393 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.297554 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.297708 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.297860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.298070 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.298237 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.298408 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.298562 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.298721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.298884 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.299045 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.299211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.299375 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.299530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.299689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.299689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.300003 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.300165 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.300389 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.300573 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.300738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.300901 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.301062 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.301216 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.301369 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.301522 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.301685 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.301839 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.302024 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.302185 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.302338 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.302501 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.302672 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.302834 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.302989 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.303141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.303293 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.303293 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.303592 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.303747 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.303898 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.304058 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.304211 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.304363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.304606 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.304764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.304924 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.305085 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.305085 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.305383 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.305549 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.305704 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.305865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.306065 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.306232 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.306396 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.306550 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.306721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.306888 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.307054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.307208 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.307368 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.307522 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.307681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.307836 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.307996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.308681 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.309019 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.309184 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.309337 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.309509 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.309670 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.309825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.310013 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.310187 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.310341 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.310494 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.310654 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.310818 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.310980 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.311142 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.311304 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.311477 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.311745 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.311933 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.312099 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.312255 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.312408 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.312561 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.312752 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.312925 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.313080 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.313080 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.313387 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.313541 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.313714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.313887 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.314075 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.314240 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.314401 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.314563 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.314725 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.314879 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.315038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.315192 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.315353 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.315513 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.315680 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.315844 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.315997 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.316149 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.316301 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.316461 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.316634 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.316634 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.316942 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.317097 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.317249 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.317401 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.317576 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.317738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.317908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.318096 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.318251 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.318421 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.318581 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.318990 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.319150 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.319310 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.319466 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.319629 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.319791 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.319953 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.320114 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.320278 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.320439 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.320604 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.320758 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.320918 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.321072 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.321224 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.321383 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.321622 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.321786 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.321941 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.322149 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.322316 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.322482 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.322653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.322755 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.322853 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.322942 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.323028 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.323141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.323224 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.323313 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.323404 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.323489 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.323579 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.323673 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.323818 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.323900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.323992 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.324082 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.324167 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.324260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.324345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.324435 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.324520 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.324603 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.324694 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.324779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.324862 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.324958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.325050 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.325141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.325238 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.325323 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.325423 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.325503 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.325594 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.325678 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.325790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.325865 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.325947 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.326076 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.326164 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.326247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.326343 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.326429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.326512 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.326601 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.326694 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.326779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.326871 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.326963 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.327049 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.327131 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.327214 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.327309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.327395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.327484 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.327569 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.327652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.327741 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.327839 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.327938 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.328024 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.328107 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.328190 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.328272 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.328404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.328583 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.328750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.328908 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.329061 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.329225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.329379 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.329550 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.329712 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.329867 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.330055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.330232 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.330397 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.330550 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.330703 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.330854 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.331007 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.331242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.331399 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.331552 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.331704 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.331856 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.332015 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.332184 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.332352 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.332524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.332686 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.332849 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.333010 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.333173 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.333359 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.333359 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.333664 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.333664 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.334001 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.334175 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.334337 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.334503 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.334656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.334817 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.334979 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.335132 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.335964 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.336052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.336136 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.336211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.336289 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.336362 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.336433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.336504 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.336583 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.336657 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.336736 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.336808 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.336879 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.336950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.337029 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.337108 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.337186 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.337431 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.337531 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.337764 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.337863 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.338099 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.338186 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.338420 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.338527 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.338741 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.338847 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.339068 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.339160 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.339938 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.340045 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.340243 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.340545 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.340638 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.340879 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.340988 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.341196 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.341392 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.341575 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.341734 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.341889 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.342126 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.342126 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.342446 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.342603 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.342764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.342937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.343091 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.343253 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.343414 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.343570 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.343729 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.343890 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.344050 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.344215 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.344376 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.344530 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.344684 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.344836 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.345004 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.345176 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.345338 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.345338 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.345646 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.345808 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.345996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.346168 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.346323 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.346475 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.346634 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.346789 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.346951 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.347122 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.347276 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.347436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.347589 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.347774 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.347937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.348092 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.348244 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.348397 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.348556 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.348710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.348876 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.349084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.349253 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.349408 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.349568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.349730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.349894 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.350077 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.350243 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.350405 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.350557 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.350720 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.350874 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.351034 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.351198 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.351357 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.351514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.351676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.351676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.351967 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.352120 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.352272 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.352433 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.352631 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.352802 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.352965 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.353427 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.353603 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.353841 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.354027 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.354188 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.354358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.354672 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.354835 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.355532 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.355693 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.355847 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.355999 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.356201 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.356426 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.356594 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.356757 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.356757 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.357048 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.357201 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.357354 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.357516 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.357516 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.357818 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.358023 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.358196 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.358371 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.358538 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.358698 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.358859 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.359020 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.359185 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.359349 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.359504 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.359656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.359816 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.359816 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.360128 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.360283 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.360457 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.360619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.360772 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.360925 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.361086 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.361248 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.361414 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.361576 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.361729 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.361881 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.362068 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.362228 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.362391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.362545 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.362697 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.362848 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.363009 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.363171 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.363333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.363495 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.363656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.363823 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.363977 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.364130 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.364283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.364446 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.364599 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.364765 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.364919 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.365078 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.365238 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.365391 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.365552 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.365725 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.365886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.366097 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.366253 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.366422 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.366574 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.366740 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.366893 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.367054 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.367207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.367367 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.367533 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.367698 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.367859 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.368019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.368180 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.368334 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.368506 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.368661 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.368814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.368966 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.369125 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.369279 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.369439 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.369601 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.369755 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.369922 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.370106 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.370260 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.370428 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.370629 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.370817 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.371027 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.371200 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.371376 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.371532 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.371687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.371840 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.372087 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.372087 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.372396 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.372396 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.372688 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.372862 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.373018 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.373170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.373170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.373477 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.373630 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.373630 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.373935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.374149 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.374149 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.374458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.374612 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.374612 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.374928 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.375093 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.375093 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.375391 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.375552 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.375552 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.375849 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.376012 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.376167 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.376319 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.376486 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.376648 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.376826 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.376987 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.377142 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.377301 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.377455 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.377607 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.377607 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.377906 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.378101 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.378258 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.378421 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.378577 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.378753 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.378908 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.379062 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.379223 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.379385 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.379549 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.379703 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.379855 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.380007 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.380159 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.380320 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.380483 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.380648 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.380800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.380952 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.381104 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.381275 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.381440 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.381601 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.381769 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.381923 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.382115 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.382277 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.382446 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.382601 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.382764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.382916 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.383075 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.383242 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.383391 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.383504 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.383595 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.383681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.383773 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.383955 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.384045 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.384139 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.384225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.384309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.384393 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.384486 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.384573 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.384657 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.384747 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.384839 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.384934 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.385058 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.385231 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.385386 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.385539 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.385702 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.385864 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.386064 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.386737 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.386894 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.387056 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.387209 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.387454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.387623 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.387785 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.387937 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.388096 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.388257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.388435 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.388589 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.388750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.388911 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.389063 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.389235 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.389396 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.389557 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.389720 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.389874 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.390079 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.390254 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.390420 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.390575 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.390729 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.390880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.391041 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.391203 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.391358 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.391510 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.391669 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.391831 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.392002 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.392167 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.392328 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.392492 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.392652 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.392811 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.392980 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.393133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.393286 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.393437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.393604 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.393757 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.393920 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.394103 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.394257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.394433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.394594 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.394756 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.394919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.395082 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.395246 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.395246 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.395537 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.395537 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.395842 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.395842 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.396138 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.396292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.396462 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.396626 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.396779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.396932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.397091 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.397245 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.397398 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.397559 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.397713 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.397873 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.398097 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.398259 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.398432 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.398594 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.398798 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.398952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.399112 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.399275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.399439 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.399593 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.399752 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.399906 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.400066 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.400222 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.400383 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.400618 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.400773 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.400927 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.401089 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.401245 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.401411 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.401573 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.401734 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.402468 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.402728 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.403004 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.403170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.403333 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.403504 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.403659 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.403812 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.403812 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.404116 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.404283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.404283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.404585 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.404745 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.404910 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.405064 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.405217 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.405370 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.405542 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.405703 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.405867 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.406080 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.406080 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.406389 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.406554 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.406722 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.406885 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.407039 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.407191 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.407343 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.407707 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.407881 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.408044 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.408199 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.408360 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.408515 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.408669 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.408837 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.408993 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.409146 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.409307 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.409468 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.409632 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.409807 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.409961 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.410156 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.410310 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.410469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.410637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.410792 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.410952 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.411106 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.411265 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.411420 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.411589 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.411756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.411917 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.412078 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.412240 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.412414 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.412579 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.412741 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.412896 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.413056 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.413218 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.413381 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.413536 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.413689 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.413853 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.414029 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.414201 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.414435 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.414599 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.414755 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.414908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.415069 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.415230 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.415394 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.415549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.415709 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.415871 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.416038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.416191 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.416357 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.416520 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.416675 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.416835 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.416990 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.417156 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.417310 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.417548 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.417711 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.417865 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.418058 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.418235 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.418398 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.418553 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.418714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.418880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.419034 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.419209 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.419372 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.419526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.419526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.419816 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.419990 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.420146 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.420299 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.420460 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.420623 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.420777 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.420939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.421094 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.421247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.421406 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.421560 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.421714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.421876 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.422073 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.422246 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.422403 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.422563 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.422731 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.422886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.423038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.423198 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.423361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.423516 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.423682 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.423836 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.424007 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.424161 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.424321 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.424475 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.424640 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.424808 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.424963 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.425116 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.425269 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.425435 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 04:20:54.425597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.425597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.425597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.425597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.425597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.425597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.425597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.425597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.426799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.426799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.426799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.426799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.427373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.427373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.427669 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.427916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.428218 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.428525 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.428860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.429197 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.429515 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.429840 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.430176 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.430502 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.430815 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.431138 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.431463 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.431781 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.432092 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.432424 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.432763 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.433063 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.433585 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.434011 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.434330 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.434644 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.434973 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.435304 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.435613 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.435940 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.436258 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.436578 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.436893 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.437204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.437534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.437845 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.438182 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.438498 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.438810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.439120 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.439433 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.439744 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.440057 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.440374 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.440689 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.441018 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.441344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.441654 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.441996 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.442329 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.442677 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.442993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.443339 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.443668 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.444241 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.444555 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.444858 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:20:54.445103 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 04:20:54.487168 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO dbcounter [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] Registered counter for database nova_api Jul 27 04:20:54.508200 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_db.sqlalchemy.engines [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:20:54.509744 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO dbcounter [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] Registered counter for database nova_api Jul 27 04:20:54.515452 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writer thread running {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:20:54.530223 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_db.sqlalchemy.engines [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:20:54.536810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writer thread running {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:20:54.571741 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.context [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),830f8882-12e3-4311-ad7f-da8e13e981d2(cell1) {{(pid=117739) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 04:20:54.576123 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:20:54.577836 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:20:54.578659 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:20:54.580888 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:20:54.582936 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO dbcounter [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] Registered counter for database nova_cell0 Jul 27 04:20:54.587332 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO dbcounter [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] Registered counter for database nova_cell1 Jul 27 04:20:54.594826 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.context [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),830f8882-12e3-4311-ad7f-da8e13e981d2(cell1) {{(pid=117740) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 04:20:54.595503 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_db.sqlalchemy.engines [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:20:54.598102 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_db.sqlalchemy.engines [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:20:54.599051 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:20:54.600699 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:20:54.601447 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:20:54.603725 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:20:54.603837 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writer thread running {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:20:54.605613 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writer thread running {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:20:54.606764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO dbcounter [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] Registered counter for database nova_cell0 Jul 27 04:20:54.610789 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO dbcounter [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] Registered counter for database nova_cell1 Jul 27 04:20:54.617838 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_db.sqlalchemy.engines [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:20:54.619475 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_db.sqlalchemy.engines [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:20:54.627189 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writer thread running {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:20:54.629806 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writer thread running {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:20:54.754111 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO dbcounter [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] Registered counter for database nova_cell0 Jul 27 04:20:54.760829 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_db.sqlalchemy.engines [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:20:54.765753 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writer thread running {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:20:54.781360 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO dbcounter [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] Registered counter for database nova_cell0 Jul 27 04:20:54.788008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_db.sqlalchemy.engines [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:20:54.793051 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writer thread running {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:20:55.093321 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: WARNING keystonemiddleware.auth_token [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 04:20:55.100895 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: WARNING keystonemiddleware.auth_token [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 04:20:55.111530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: WARNING keystonemiddleware.auth_token [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 04:20:55.118779 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: WARNING keystonemiddleware.auth_token [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 04:20:55.451336 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: WARNING keystonemiddleware.auth_token [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 04:20:55.457254 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: WARNING keystonemiddleware.auth_token [None req-1e9af41b-7ea1-4a60-8c55-7981a69cbfa0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 04:20:55.462622 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f3d23319c0 pid: 117739 (default app) Jul 27 04:20:55.466653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: WARNING keystonemiddleware.auth_token [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 04:20:55.472564 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: WARNING keystonemiddleware.auth_token [None req-f01648e6-db26-4caa-96c6-d7546415d670 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 04:20:55.477860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f3d23319c0 pid: 117740 (default app) Jul 27 04:21:36.492979 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=3 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:36.494614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=3 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:36.495753 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=3 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:36.496690 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=3 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:36.627815 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=3 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:36.631075 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=3 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:36.632339 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=3 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:36.633337 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=3 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:38.578784 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8a459d68-ceea-43e0-9975-8125e147c9bc tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Action: 'create', calling method: .version_select at 0x7f21d7bea940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2131343548"}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:21:38.676639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-648f6d85-8ecc-4eb6-a899-2886e880ae13 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Action: 'create', calling method: .version_select at 0x7f21d7bea940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1676242413", "metadata": {"Type": "work"}}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-648f6d85-8ecc-4eb6-a899-2886e880ae13 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Request method failure captured: Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 122 Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L1QOHA6ctgEWPFcp8pgxJKdaDXEt5H-lLv3JA7Cw4Og7zKaqbsLCzK3HiYrtqwkhNyPhybB0Od_5btr-LmUWtyeE1jy8MZLpuN-Se8b8IbmULSuWGRshEt--gODz580FswnWNMkJYmJAst4FyTezZGeICYvKm0aKZhSIClF_-Pj928 Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: b97850dff881499c9c9d6a66d43adfb4 Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:21:38.695898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:21:38.697524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:21:38.697524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:38.697524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: b97850dff881499c9c9d6a66d43adfb4 Jul 27 04:21:38.697524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:38.697524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-VolumesNegativeTest-944900708-project Jul 27 04:21:38.697524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:21:38.697524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:21:38.697524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: d2b422350e7d4995ba31ccefa9333dcf Jul 27 04:21:38.697524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-VolumesNegativeTest-944900708-project Jul 27 04:21:38.697524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Jul 27 04:21:38.697524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1676242413", "metadata": {"Type": "work"}}} Jul 27 04:21:38.697524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: Jul 27 04:21:38.697524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1676242413', 'metadata': {'Type': 'work'}}}} Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise error Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi '#$%' Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:21:38.699089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 04:21:38.700717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 04:21:38.702162 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 04:21:38.702162 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.717114 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-648f6d85-8ecc-4eb6-a899-2886e880ae13 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:21:38.718621 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-648f6d85-8ecc-4eb6-a899-2886e880ae13 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.096138 Jul 27 04:21:38.719771 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1156 bytes} [Wed Jul 27 04:21:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2099 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 04:21:38.731301 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-92b108b3-23fb-4e86-be3e-400faf46148a tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Action: 'create', calling method: .version_select at 0x7f21d7bea9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-736603144", "metadata": {"Type": "work"}}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-92b108b3-23fb-4e86-be3e-400faf46148a tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Request method failure captured: Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 119 Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L1QOHA6ctgEWPFcp8pgxJKdaDXEt5H-lLv3JA7Cw4Og7zKaqbsLCzK3HiYrtqwkhNyPhybB0Od_5btr-LmUWtyeE1jy8MZLpuN-Se8b8IbmULSuWGRshEt--gODz580FswnWNMkJYmJAst4FyTezZGeICYvKm0aKZhSIClF_-Pj928 Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: b97850dff881499c9c9d6a66d43adfb4 Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:21:38.736639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:21:38.737931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:21:38.737931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:38.737931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: b97850dff881499c9c9d6a66d43adfb4 Jul 27 04:21:38.737931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:38.737931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-VolumesNegativeTest-944900708-project Jul 27 04:21:38.737931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:21:38.737931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:21:38.737931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: d2b422350e7d4995ba31ccefa9333dcf Jul 27 04:21:38.737931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-VolumesNegativeTest-944900708-project Jul 27 04:21:38.737931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Jul 27 04:21:38.737931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-736603144", "metadata": {"Type": "work"}}} Jul 27 04:21:38.737931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: Jul 27 04:21:38.737931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-736603144', 'metadata': {'Type': 'work'}}}} Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise error Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi '0' Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:21:38.738748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 04:21:38.740008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 04:21:38.741102 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 04:21:38.741102 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.745250 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-92b108b3-23fb-4e86-be3e-400faf46148a tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:21:38.746362 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-92b108b3-23fb-4e86-be3e-400faf46148a tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020477 Jul 27 04:21:38.747936 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 2/2] 10.222.0.46 () {60 vars in 1156 bytes} [Wed Jul 27 04:21:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 04:21:38.786061 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d91e1ea3-47dd-47f6-a173-0737df0baff4 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Action: 'create', calling method: .version_select at 0x7f21d7aa24c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1206777261", "metadata": {"Type": "work"}}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d91e1ea3-47dd-47f6-a173-0737df0baff4 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Request method failure captured: Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 119 Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L1QOHA6ctgEWPFcp8pgxJKdaDXEt5H-lLv3JA7Cw4Og7zKaqbsLCzK3HiYrtqwkhNyPhybB0Od_5btr-LmUWtyeE1jy8MZLpuN-Se8b8IbmULSuWGRshEt--gODz580FswnWNMkJYmJAst4FyTezZGeICYvKm0aKZhSIClF_-Pj928 Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: b97850dff881499c9c9d6a66d43adfb4 Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:21:38.797257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:21:38.798869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:21:38.798869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:38.798869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: b97850dff881499c9c9d6a66d43adfb4 Jul 27 04:21:38.798869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:38.798869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-VolumesNegativeTest-944900708-project Jul 27 04:21:38.798869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:21:38.798869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:21:38.798869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: d2b422350e7d4995ba31ccefa9333dcf Jul 27 04:21:38.798869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-VolumesNegativeTest-944900708-project Jul 27 04:21:38.798869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Jul 27 04:21:38.798869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1206777261", "metadata": {"Type": "work"}}} Jul 27 04:21:38.798869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: Jul 27 04:21:38.798869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1206777261', 'metadata': {'Type': 'work'}}}} Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise error Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi '' Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:21:38.799665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 04:21:38.801001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 04:21:38.805113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 04:21:38.805113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:38.810277 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d91e1ea3-47dd-47f6-a173-0737df0baff4 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:21:38.811308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d91e1ea3-47dd-47f6-a173-0737df0baff4 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.057426 Jul 27 04:21:38.818397 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 3/3] 10.222.0.46 () {60 vars in 1156 bytes} [Wed Jul 27 04:21:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 04:21:38.830695 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-fc78dde5-a699-4dbc-bc1f-1e96212a8427 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Calling method '.version_select at 0x7f21d7aa2ee0>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:39.599579 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-fc78dde5-a699-4dbc-bc1f-1e96212a8427 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] HTTP exception thrown: Volume tempest-invalid-1435369746 could not be found. Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-fc78dde5-a699-4dbc-bc1f-1e96212a8427 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Request method failure captured: Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1435369746 HTTP/1.1 Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L1QOHA6ctgEWPFcp8pgxJKdaDXEt5H-lLv3JA7Cw4Og7zKaqbsLCzK3HiYrtqwkhNyPhybB0Od_5btr-LmUWtyeE1jy8MZLpuN-Se8b8IbmULSuWGRshEt--gODz580FswnWNMkJYmJAst4FyTezZGeICYvKm0aKZhSIClF_-Pj928 Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: b97850dff881499c9c9d6a66d43adfb4 Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:21:39.603292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:21:39.606036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:21:39.606036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:39.606036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: b97850dff881499c9c9d6a66d43adfb4 Jul 27 04:21:39.606036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:39.606036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-VolumesNegativeTest-944900708-project Jul 27 04:21:39.606036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:21:39.606036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:21:39.606036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: d2b422350e7d4995ba31ccefa9333dcf Jul 27 04:21:39.606036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-VolumesNegativeTest-944900708-project Jul 27 04:21:39.606036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: Jul 27 04:21:39.606036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Volume tempest-invalid-1435369746 could not be found. Jul 27 04:21:39.606036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': 'tempest-invalid-1435369746'} Jul 27 04:21:39.606036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1435369746 could not be found. (HTTP 404) (Request-ID: req-375418ce-c7fc-4242-8067-947618c79ef2) Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:39.606975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 04:21:39.608436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1435369746 could not be found. Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:21:39.610080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1435369746 could not be found. Jul 27 04:21:39.611697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.611697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:39.611697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.611697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:39.611697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:39.611697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:39.611697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:21:39.611697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:21:39.611697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1435369746 could not be found. Jul 27 04:21:39.611697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.611697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-fc78dde5-a699-4dbc-bc1f-1e96212a8427 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Returning 404 to user: Volume tempest-invalid-1435369746 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:21:39.611697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-fc78dde5-a699-4dbc-bc1f-1e96212a8427 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1435369746" status: 404 len: 99 microversion: 2.1 time: 0.781608 Jul 27 04:21:39.616508 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 4/4] 10.222.0.46 () {58 vars in 1218 bytes} [Wed Jul 27 04:21:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1435369746 => generated 99 bytes in 797 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 27 04:21:39.623258 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-57f8c954-57d9-4dae-bbfd-76ba813d5d22 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005480 Jul 27 04:21:39.632696 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 5/5] 10.222.0.46 () {58 vars in 1140 bytes} [Wed Jul 27 04:21:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 04:21:39.645864 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-60e0e929-68de-45a2-a236-b7480fb856dc tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010583 Jul 27 04:21:39.649477 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 6/6] 10.222.0.46 () {58 vars in 1137 bytes} [Wed Jul 27 04:21:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 04:21:39.664946 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-bbb073f9-c281-465f-b3e8-0574c62cccd7 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Calling method '.version_select at 0x7f21d79d5790>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:39.868830 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-bbb073f9-c281-465f-b3e8-0574c62cccd7 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] HTTP exception thrown: Volume 0200da2d-fef5-4a38-8dcb-a1675aa7b081 could not be found. Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-bbb073f9-c281-465f-b3e8-0574c62cccd7 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Request method failure captured: Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: DELETE /compute/v2.1/os-volumes/0200da2d-fef5-4a38-8dcb-a1675aa7b081 HTTP/1.1 Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L1QOHA6ctgEWPFcp8pgxJKdaDXEt5H-lLv3JA7Cw4Og7zKaqbsLCzK3HiYrtqwkhNyPhybB0Od_5btr-LmUWtyeE1jy8MZLpuN-Se8b8IbmULSuWGRshEt--gODz580FswnWNMkJYmJAst4FyTezZGeICYvKm0aKZhSIClF_-Pj928 Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: b97850dff881499c9c9d6a66d43adfb4 Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:21:39.872492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:21:39.873756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:21:39.873756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:39.873756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: b97850dff881499c9c9d6a66d43adfb4 Jul 27 04:21:39.873756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:39.873756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-VolumesNegativeTest-944900708-project Jul 27 04:21:39.873756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:21:39.873756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:21:39.873756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: d2b422350e7d4995ba31ccefa9333dcf Jul 27 04:21:39.873756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-VolumesNegativeTest-944900708-project Jul 27 04:21:39.873756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: Jul 27 04:21:39.873756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Volume 0200da2d-fef5-4a38-8dcb-a1675aa7b081 could not be found. Jul 27 04:21:39.873756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '0200da2d-fef5-4a38-8dcb-a1675aa7b081'} Jul 27 04:21:39.873756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0200da2d-fef5-4a38-8dcb-a1675aa7b081 could not be found. (HTTP 404) (Request-ID: req-c0ad42dc-5f17-4a01-ab8d-c967923c7d08) Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:39.874619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 04:21:39.875714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0200da2d-fef5-4a38-8dcb-a1675aa7b081 could not be found. Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 04:21:39.876791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:21:39.879203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0200da2d-fef5-4a38-8dcb-a1675aa7b081 could not be found. Jul 27 04:21:39.879203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.879203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:39.879203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.879203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:39.879203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:39.879203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:39.879203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:21:39.879203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:21:39.879203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0200da2d-fef5-4a38-8dcb-a1675aa7b081 could not be found. Jul 27 04:21:39.879203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:39.882156 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-bbb073f9-c281-465f-b3e8-0574c62cccd7 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Returning 404 to user: Volume 0200da2d-fef5-4a38-8dcb-a1675aa7b081 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:21:39.883407 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-bbb073f9-c281-465f-b3e8-0574c62cccd7 tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/0200da2d-fef5-4a38-8dcb-a1675aa7b081" status: 404 len: 109 microversion: 2.1 time: 0.228267 Jul 27 04:21:39.884260 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 7/7] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Jul 27 04:21:39 2022] DELETE /compute/v2.1/os-volumes/0200da2d-fef5-4a38-8dcb-a1675aa7b081 => generated 109 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 04:21:39.895169 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-41c273ba-0cd1-4796-854a-99a71134817d tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Calling method '.version_select at 0x7f21d79d5940>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:40.097191 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-41c273ba-0cd1-4796-854a-99a71134817d tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] HTTP exception thrown: Volume 1b051bd4-1e48-4434-8407-6cb0b3bb6af3 could not be found. Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-41c273ba-0cd1-4796-854a-99a71134817d tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Request method failure captured: Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/os-volumes/1b051bd4-1e48-4434-8407-6cb0b3bb6af3 HTTP/1.1 Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L1QOHA6ctgEWPFcp8pgxJKdaDXEt5H-lLv3JA7Cw4Og7zKaqbsLCzK3HiYrtqwkhNyPhybB0Od_5btr-LmUWtyeE1jy8MZLpuN-Se8b8IbmULSuWGRshEt--gODz580FswnWNMkJYmJAst4FyTezZGeICYvKm0aKZhSIClF_-Pj928 Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: b97850dff881499c9c9d6a66d43adfb4 Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:21:40.100428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:21:40.102307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b97850dff881499c9c9d6a66d43adfb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:21:40.102307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:40.102307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: b97850dff881499c9c9d6a66d43adfb4 Jul 27 04:21:40.102307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-VolumesNegativeTest-944900708 Jul 27 04:21:40.102307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-VolumesNegativeTest-944900708-project Jul 27 04:21:40.102307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:21:40.102307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:21:40.102307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: d2b422350e7d4995ba31ccefa9333dcf Jul 27 04:21:40.102307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-VolumesNegativeTest-944900708-project Jul 27 04:21:40.102307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: Jul 27 04:21:40.102307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Volume 1b051bd4-1e48-4434-8407-6cb0b3bb6af3 could not be found. Jul 27 04:21:40.102307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '1b051bd4-1e48-4434-8407-6cb0b3bb6af3'} Jul 27 04:21:40.102307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b051bd4-1e48-4434-8407-6cb0b3bb6af3 could not be found. (HTTP 404) (Request-ID: req-d48b7dc9-4b21-4b74-b1b1-f2c46e7c8462) Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:40.103198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 04:21:40.104800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b051bd4-1e48-4434-8407-6cb0b3bb6af3 could not be found. Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 04:21:40.106113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:21:40.107412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b051bd4-1e48-4434-8407-6cb0b3bb6af3 could not be found. Jul 27 04:21:40.107412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:40.107412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:40.107412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:40.107412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:40.107412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:40.107412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:40.107412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:21:40.107412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:21:40.107412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b051bd4-1e48-4434-8407-6cb0b3bb6af3 could not be found. Jul 27 04:21:40.107412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:40.110293 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-41c273ba-0cd1-4796-854a-99a71134817d tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] Returning 404 to user: Volume 1b051bd4-1e48-4434-8407-6cb0b3bb6af3 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:21:40.111426 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-41c273ba-0cd1-4796-854a-99a71134817d tempest-VolumesNegativeTest-944900708 tempest-VolumesNegativeTest-944900708-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1b051bd4-1e48-4434-8407-6cb0b3bb6af3" status: 404 len: 109 microversion: 2.1 time: 0.221239 Jul 27 04:21:40.112806 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 8/8] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:39 2022] GET /compute/v2.1/os-volumes/1b051bd4-1e48-4434-8407-6cb0b3bb6af3 => generated 109 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 04:21:40.246851 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ac84cb06-17b9-44b9-88ad-6cd7d63768d2 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] Calling method '.version_select at 0x7f21d7a22ca0>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:40.331224 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8a459d68-ceea-43e0-9975-8125e147c9bc tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.857299 Jul 27 04:21:40.331890 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 1/9] 10.222.0.46 () {60 vars in 1155 bytes} [Wed Jul 27 04:21:36 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3861 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 04:21:40.350682 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0aee7f18-3f6a-492c-9450-1c6227664625 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d7a3d790>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:40.442208 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ac84cb06-17b9-44b9-88ad-6cd7d63768d2 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/27cf37f6-21f6-4ff9-8b90-9f4e8fa4cd7c" status: 200 len: 351 microversion: 2.1 time: 0.204212 Jul 27 04:21:40.443052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 9/10] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:40 2022] GET /compute/v2.1/os-volumes/27cf37f6-21f6-4ff9-8b90-9f4e8fa4cd7c => generated 351 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:40.535014 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0aee7f18-3f6a-492c-9450-1c6227664625 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d" status: 200 len: 345 microversion: 2.1 time: 0.192170 Jul 27 04:21:40.536100 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 2/11] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:40 2022] GET /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d => generated 345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:21:41.549812 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e87c69cd-fbab-42eb-8826-6d9e111ec5b1 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d79d5940>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:41.626118 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e87c69cd-fbab-42eb-8826-6d9e111ec5b1 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d" status: 200 len: 346 microversion: 2.1 time: 0.080749 Jul 27 04:21:41.626699 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 10/12] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:41 2022] GET /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:41.653024 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8bf0035a-f0c3-4aac-9088-eabf48915092 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Action: 'create', calling method: .version_select at 0x7f21d7a3ddc0>, body: {"snapshot": {"volume_id": "9a5a4959-809e-44db-97c1-263f51f4b75d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1298370245"}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:21:42.122255 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8bf0035a-f0c3-4aac-9088-eabf48915092 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.484830 Jul 27 04:21:42.128919 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 3/13] 10.222.0.46 () {60 vars in 1162 bytes} [Wed Jul 27 04:21:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:42.134535 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a959615a-270b-429d-a402-575a789abc63 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d79d5dc0>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:42.180423 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a959615a-270b-429d-a402-575a789abc63 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96" status: 200 len: 287 microversion: 2.1 time: 0.050095 Jul 27 04:21:42.181846 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 11/14] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Jul 27 04:21:42 2022] GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:42.195902 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-cb118324-def5-42ba-9281-936c57b00b2a tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d7a54f70>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:42.314326 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b4e5d0a8-75bd-4e32-b082-732284de980d tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] Calling method '.version_select at 0x7f21d79df4c0>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:42.375103 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-cb118324-def5-42ba-9281-936c57b00b2a tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.185419 Jul 27 04:21:42.375941 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 4/15] 10.222.0.46 () {58 vars in 1140 bytes} [Wed Jul 27 04:21:42 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:42.392635 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-95a10394-aa2a-489b-861f-a992e84370e5 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d8412ca0>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:42.466567 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b4e5d0a8-75bd-4e32-b082-732284de980d tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/2f614a9d-5458-4697-bc77-d8b86caf3389" status: 200 len: 350 microversion: 2.1 time: 0.157420 Jul 27 04:21:42.467295 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 12/16] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:42 2022] GET /compute/v2.1/os-volumes/2f614a9d-5458-4697-bc77-d8b86caf3389 => generated 350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:21:42.596908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-95a10394-aa2a-489b-861f-a992e84370e5 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96" status: 200 len: 287 microversion: 2.1 time: 0.208069 Jul 27 04:21:42.598091 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 5/17] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Jul 27 04:21:42 2022] GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96 => generated 287 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:43.611403 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1701021f-2b6c-4179-a6ca-fbb0a1f76d37 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d79d58b0>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:43.690549 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-1701021f-2b6c-4179-a6ca-fbb0a1f76d37 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96" status: 200 len: 287 microversion: 2.1 time: 0.084251 Jul 27 04:21:43.695635 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 13/18] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Jul 27 04:21:43 2022] GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:21:44.706037 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9b2b4c3d-40ae-449f-99f5-d67dd6e268a5 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d7a3db80>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:44.756307 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9b2b4c3d-40ae-449f-99f5-d67dd6e268a5 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96" status: 200 len: 287 microversion: 2.1 time: 0.056381 Jul 27 04:21:44.758244 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 6/19] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Jul 27 04:21:44 2022] GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:45.772405 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7e9a04a2-7d9f-4045-a3e1-b1e79fed1cfb tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d79d5ca0>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:45.847896 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-7e9a04a2-7d9f-4045-a3e1-b1e79fed1cfb tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96" status: 200 len: 288 microversion: 2.1 time: 0.080828 Jul 27 04:21:45.855828 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 14/20] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Jul 27 04:21:45 2022] GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96 => generated 288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:45.861373 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-a21149a4-6185-4451-8860-11c8c04aa91b tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d7a5a1f0>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:46.073172 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-a21149a4-6185-4451-8860-11c8c04aa91b tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96" status: 202 len: 0 microversion: 2.1 time: 0.215683 Jul 27 04:21:46.074540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 7/21] 10.222.0.46 () {58 vars in 1254 bytes} [Wed Jul 27 04:21:45 2022] DELETE /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:21:46.085286 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1cd6231d-aa90-47b6-af6b-e16c51c31c31 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d7a22d30>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:46.175319 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-1cd6231d-aa90-47b6-af6b-e16c51c31c31 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96" status: 200 len: 287 microversion: 2.1 time: 0.095669 Jul 27 04:21:46.177817 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 15/22] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Jul 27 04:21:46 2022] GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:46.603046 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-dda18404-03fe-43b7-9723-3bc9a9d56ba9 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] Calling method '.version_select at 0x7f21d79df670>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:46.736716 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-dda18404-03fe-43b7-9723-3bc9a9d56ba9 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/210e58cb-5084-4a6f-825a-ac32605af9a8" status: 200 len: 351 microversion: 2.1 time: 0.137194 Jul 27 04:21:46.737205 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 16/23] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:46 2022] GET /compute/v2.1/os-volumes/210e58cb-5084-4a6f-825a-ac32605af9a8 => generated 351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:21:46.751208 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9f9d2986-ba9f-47d4-a24a-78a28d241ac1 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] Calling method '.version_select at 0x7f21d7ab1160>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:46.924489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-9f9d2986-ba9f-47d4-a24a-78a28d241ac1 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.177267 Jul 27 04:21:46.925067 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 17/24] 10.222.0.46 () {58 vars in 1134 bytes} [Wed Jul 27 04:21:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:21:46.939367 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-6d79df49-e68e-47cd-94b7-1ce3dc15df31 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] Calling method '.version_select at 0x7f21d79df310>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:46.970811 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2025023037", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:21:47.179901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-6d79df49-e68e-47cd-94b7-1ce3dc15df31 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.244072 Jul 27 04:21:47.181303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 18/25] 10.222.0.46 () {58 vars in 1149 bytes} [Wed Jul 27 04:21:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:21:47.198606 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e8b24a7f-db4e-4196-a917-d895f70fbc51 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d79e8430>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:47.238634 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] validate_networks() for [('9b6659b1-b144-4a0f-8066-b48287eea6b5', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:21:47.259520 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-e8b24a7f-db4e-4196-a917-d895f70fbc51 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] HTTP exception thrown: Snapshot 4ee803dc-824a-4215-bb89-65b407ebdc96 could not be found. Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e8b24a7f-db4e-4196-a917-d895f70fbc51 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Request method failure captured: Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96 HTTP/1.1 Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L1QQIagzxjixDdt3HzcnsIJeL6Nr6t3kcIg0cUTvmuIyhSLW5bcfVRkSjQx4GwL3_z7qhOmBZ4XDat4c30686aMQGFEOj0iTUoFchBF07jduGVJl8iKFg7L1_9ZeGQLO799Wv6Hu7PEHWS2tMinwf5jXyhex4u86ZAmNot7nEyYv8w Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 3a0b9dd0d94644b1bbac5f379c8d021c Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2040948061 Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:21:47.262753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:21:47.264172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:21:47.264172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2040948061 Jul 27 04:21:47.264172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 3a0b9dd0d94644b1bbac5f379c8d021c Jul 27 04:21:47.264172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2040948061 Jul 27 04:21:47.264172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-VolumesSnapshotsTestJSON-2040948061-project Jul 27 04:21:47.264172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:21:47.264172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:21:47.264172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 7845ef787bc5446786f5c7ce9dea9863 Jul 27 04:21:47.264172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2040948061-project Jul 27 04:21:47.264172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: Jul 27 04:21:47.264172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Snapshot 4ee803dc-824a-4215-bb89-65b407ebdc96 could not be found. Jul 27 04:21:47.264172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '4ee803dc-824a-4215-bb89-65b407ebdc96'} Jul 27 04:21:47.264172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4ee803dc-824a-4215-bb89-65b407ebdc96 could not be found. (HTTP 404) (Request-ID: req-f0f92b34-f92b-4583-8346-6cdcc9e112b3) Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:47.265141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 04:21:47.266308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4ee803dc-824a-4215-bb89-65b407ebdc96 could not be found. Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 27 04:21:47.267600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:21:47.269734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4ee803dc-824a-4215-bb89-65b407ebdc96 could not be found. Jul 27 04:21:47.269734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:47.269734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:47.269734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:47.269734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:47.269734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:47.269734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:47.269734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:21:47.269734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:21:47.269734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4ee803dc-824a-4215-bb89-65b407ebdc96 could not be found. Jul 27 04:21:47.269734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:21:47.272871 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e8b24a7f-db4e-4196-a917-d895f70fbc51 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Returning 404 to user: Snapshot 4ee803dc-824a-4215-bb89-65b407ebdc96 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:21:47.274380 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e8b24a7f-db4e-4196-a917-d895f70fbc51 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96" status: 404 len: 111 microversion: 2.1 time: 0.081989 Jul 27 04:21:47.276860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 19/26] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Jul 27 04:21:47 2022] GET /compute/v2.1/os-snapshots/4ee803dc-824a-4215-bb89-65b407ebdc96 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:21:47.285060 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f1a22629-591d-4c57-a344-537aea0bd89a tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] Calling method '.version_select at 0x7f21d79df3a0>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:47.510717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f1a22629-591d-4c57-a344-537aea0bd89a tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.231763 Jul 27 04:21:47.511861 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 20/27] 10.222.0.46 () {58 vars in 1134 bytes} [Wed Jul 27 04:21:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:47.517005 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4389343b-4c00-48c6-b602-6578e67ab278 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d79d5040>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:47.655464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4389343b-4c00-48c6-b602-6578e67ab278 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d" status: 202 len: 0 microversion: 2.1 time: 0.142023 Jul 27 04:21:47.656355 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 21/28] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Jul 27 04:21:47 2022] DELETE /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:21:47.663700 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b61f5c82-bec6-4229-8cd9-edfe95c46ff3 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] Calling method '.version_select at 0x7f21d79d5940>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:47.948497 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b61f5c82-bec6-4229-8cd9-edfe95c46ff3 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.290126 Jul 27 04:21:47.949242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 22/29] 10.222.0.46 () {58 vars in 1167 bytes} [Wed Jul 27 04:21:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:47.955165 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e8ae8480-aea5-4fae-9a21-c7a6ecb591e4 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d79df1f0>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:48.088085 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e8ae8480-aea5-4fae-9a21-c7a6ecb591e4 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d" status: 200 len: 345 microversion: 2.1 time: 0.137275 Jul 27 04:21:48.089020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 23/30] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:47 2022] GET /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:48.582746 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1039912336", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "networks": [{"uuid": "4852253d-e86e-40c9-8848-56097aa72270"}]}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:21:48.834579 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.network.neutron [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] validate_networks() for [('4852253d-e86e-40c9-8848-56097aa72270', None, None, None, None, None)] {{(pid=117740) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:21:50.113870 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:21:50.116488 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:21:50.117612 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:21:50.118384 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:21:50.118940 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:21:50.157530 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:50.159820 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:50.161941 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:50.162653 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:50.251292 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Getting quotas for project 5bb7f3d2bc1e4651b7f1e0ac6debd89a. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:21:50.265466 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Getting quotas for user 5a69202d87094049b12765d64c17e515 and project 5bb7f3d2bc1e4651b7f1e0ac6debd89a. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:21:50.312233 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:21:50.318202 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:21:50.491290 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8130e5bb-2420-4230-a6d7-0fdb7a0cec92 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.298241 Jul 27 04:21:50.495079 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 8/31] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:21:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 4303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:21:50.519322 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-fb24af88-6435-4972-8339-d3cd9fb5c0ce tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] Calling method '.version_select at 0x7f21d796d3a0>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:50.573268 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Flavor limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:21:50.574567 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Image limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:21:50.575249 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Flavor pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:21:50.575799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Image pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:21:50.576516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:21:50.611882 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:50.612189 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:50.613001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:50.613440 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:50.771338 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Getting quotas for project 7c14d53ffc0d4d90b7cbfbb6b3b5a83b. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:21:50.800110 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Getting quotas for user a430d7aa4dcf40e399fcb5d1f4bf3f76 and project 7c14d53ffc0d4d90b7cbfbb6b3b5a83b. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:21:50.813835 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-fb24af88-6435-4972-8339-d3cd9fb5c0ce tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.317300 Jul 27 04:21:50.815746 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 9/32] 10.222.0.46 () {58 vars in 1170 bytes} [Wed Jul 27 04:21:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:50.825003 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5b524846-7fc9-4a31-bf62-4f105568a504 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d68f75e0>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:50.865366 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Going to run 1 instances... {{(pid=117740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:21:50.883638 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:21:50.975167 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-5b524846-7fc9-4a31-bf62-4f105568a504 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] HTTP exception thrown: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5b524846-7fc9-4a31-bf62-4f105568a504 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Request method failure captured: Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d HTTP/1.1 Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L1QQIagzxjixDdt3HzcnsIJeL6Nr6t3kcIg0cUTvmuIyhSLW5bcfVRkSjQx4GwL3_z7qhOmBZ4XDat4c30686aMQGFEOj0iTUoFchBF07jduGVJl8iKFg7L1_9ZeGQLO799Wv6Hu7PEHWS2tMinwf5jXyhex4u86ZAmNot7nEyYv8w Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: 3a0b9dd0d94644b1bbac5f379c8d021c Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2040948061 Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:21:50.983568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:21:50.984605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:21:50.984605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2040948061 Jul 27 04:21:50.984605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: 3a0b9dd0d94644b1bbac5f379c8d021c Jul 27 04:21:50.984605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2040948061 Jul 27 04:21:50.984605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-VolumesSnapshotsTestJSON-2040948061-project Jul 27 04:21:50.984605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:21:50.984605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:21:50.984605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 7845ef787bc5446786f5c7ce9dea9863 Jul 27 04:21:50.984605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2040948061-project Jul 27 04:21:50.984605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: Jul 27 04:21:50.984605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:50.984605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '9a5a4959-809e-44db-97c1-263f51f4b75d'} Jul 27 04:21:50.984605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. (HTTP 404) (Request-ID: req-3d37187c-2a9b-4f19-9a49-e826a36e4682) Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:50.985207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 04:21:50.986628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 04:21:50.987498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5b524846-7fc9-4a31-bf62-4f105568a504 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Returning 404 to user: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-5b524846-7fc9-4a31-bf62-4f105568a504 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d" status: 404 len: 109 microversion: 2.1 time: 0.168194 Jul 27 04:21:50.988367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 10/33] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:50 2022] GET /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d => generated 109 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:21:51.006250 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6569a0e8-179f-4659-8015-6f89563208f0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:51.007458 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6569a0e8-179f-4659-8015-6f89563208f0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:51.103573 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a5d89a32-f2db-4e1d-99ef-c5ca7c1d7b4c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.013222 Jul 27 04:21:51.104250 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 24/34] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:21:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:21:51.110423 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7801344c-54b8-4996-a19a-a17539ee2b92 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] Calling method '.version_select at 0x7f21d78dda60>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:51.214469 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6569a0e8-179f-4659-8015-6f89563208f0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:21:51.254936 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6569a0e8-179f-4659-8015-6f89563208f0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1222 microversion: 2.1 time: 0.262263 Jul 27 04:21:51.266377 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 11/35] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:50 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1222 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:51.287320 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e207b25c-e3d8-4d8f-a7c1-6fbf23469f9f tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d68f7430>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:51.339595 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-7801344c-54b8-4996-a19a-a17539ee2b92 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.233272 Jul 27 04:21:51.347702 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 25/36] 10.222.0.46 () {58 vars in 1155 bytes} [Wed Jul 27 04:21:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:51.347702 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e76592ea-016a-45cb-9733-2658dacf0fd5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:51.348001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e76592ea-016a-45cb-9733-2658dacf0fd5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:51.374486 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-e207b25c-e3d8-4d8f-a7c1-6fbf23469f9f tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] HTTP exception thrown: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e207b25c-e3d8-4d8f-a7c1-6fbf23469f9f tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Request method failure captured: Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: DELETE /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d HTTP/1.1 Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L1QQIagzxjixDdt3HzcnsIJeL6Nr6t3kcIg0cUTvmuIyhSLW5bcfVRkSjQx4GwL3_z7qhOmBZ4XDat4c30686aMQGFEOj0iTUoFchBF07jduGVJl8iKFg7L1_9ZeGQLO799Wv6Hu7PEHWS2tMinwf5jXyhex4u86ZAmNot7nEyYv8w Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: 3a0b9dd0d94644b1bbac5f379c8d021c Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2040948061 Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:21:51.377886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:21:51.379056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:21:51.379056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2040948061 Jul 27 04:21:51.379056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: 3a0b9dd0d94644b1bbac5f379c8d021c Jul 27 04:21:51.379056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2040948061 Jul 27 04:21:51.379056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-VolumesSnapshotsTestJSON-2040948061-project Jul 27 04:21:51.379056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:21:51.379056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:21:51.379056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 7845ef787bc5446786f5c7ce9dea9863 Jul 27 04:21:51.379056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2040948061-project Jul 27 04:21:51.379056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: Jul 27 04:21:51.379056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:51.379056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '9a5a4959-809e-44db-97c1-263f51f4b75d'} Jul 27 04:21:51.379056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. (HTTP 404) (Request-ID: req-6e3152ef-d26f-4f4c-88cd-15b0e53b659a) Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:51.379681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 04:21:51.380880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 04:21:51.381814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:21:51.382765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:51.382765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.382765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:51.382765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.382765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:51.382765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:51.382765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:51.382765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:21:51.382765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:21:51.382765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:51.382765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.386407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e207b25c-e3d8-4d8f-a7c1-6fbf23469f9f tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Returning 404 to user: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:21:51.387601 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e207b25c-e3d8-4d8f-a7c1-6fbf23469f9f tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d" status: 404 len: 109 microversion: 2.1 time: 0.120044 Jul 27 04:21:51.388670 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 12/37] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Jul 27 04:21:51 2022] DELETE /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:21:51.393706 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5e705519-3dd9-4536-9eb5-efd1de52d8e1 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] Calling method '.version_select at 0x7f21d6875670>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:51.590541 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-5e705519-3dd9-4536-9eb5-efd1de52d8e1 tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.200383 Jul 27 04:21:51.591146 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 13/38] 10.222.0.46 () {58 vars in 1188 bytes} [Wed Jul 27 04:21:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:51.595637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c650285e-5a2b-4949-b467-a33e223edcb3 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Calling method '.version_select at 0x7f21d6882c10>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:51.668663 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e76592ea-016a-45cb-9733-2658dacf0fd5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:21:51.674055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-c650285e-5a2b-4949-b467-a33e223edcb3 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] HTTP exception thrown: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c650285e-5a2b-4949-b467-a33e223edcb3 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Request method failure captured: Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d HTTP/1.1 Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L1QQIagzxjixDdt3HzcnsIJeL6Nr6t3kcIg0cUTvmuIyhSLW5bcfVRkSjQx4GwL3_z7qhOmBZ4XDat4c30686aMQGFEOj0iTUoFchBF07jduGVJl8iKFg7L1_9ZeGQLO799Wv6Hu7PEHWS2tMinwf5jXyhex4u86ZAmNot7nEyYv8w Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: 3a0b9dd0d94644b1bbac5f379c8d021c Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2040948061 Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:21:51.676404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:21:51.677710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3a0b9dd0d94644b1bbac5f379c8d021c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:21:51.677710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2040948061 Jul 27 04:21:51.677710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: 3a0b9dd0d94644b1bbac5f379c8d021c Jul 27 04:21:51.677710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2040948061 Jul 27 04:21:51.677710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-VolumesSnapshotsTestJSON-2040948061-project Jul 27 04:21:51.677710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:21:51.677710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:21:51.677710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 7845ef787bc5446786f5c7ce9dea9863 Jul 27 04:21:51.677710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2040948061-project Jul 27 04:21:51.677710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: Jul 27 04:21:51.677710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:51.677710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '9a5a4959-809e-44db-97c1-263f51f4b75d'} Jul 27 04:21:51.677710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. (HTTP 404) (Request-ID: req-2aaf5be9-ed0c-445f-8130-eb7a416537be) Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:51.678591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 04:21:51.679677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 04:21:51.680624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:21:51.681509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:51.681509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.681509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:21:51.681509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.681509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:21:51.681509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:21:51.681509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:21:51.681509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:21:51.681509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:21:51.681509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. Jul 27 04:21:51.681509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:21:51.683875 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c650285e-5a2b-4949-b467-a33e223edcb3 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] Returning 404 to user: Volume 9a5a4959-809e-44db-97c1-263f51f4b75d could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:21:51.684871 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c650285e-5a2b-4949-b467-a33e223edcb3 tempest-VolumesSnapshotsTestJSON-2040948061 tempest-VolumesSnapshotsTestJSON-2040948061-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d" status: 404 len: 109 microversion: 2.1 time: 0.092835 Jul 27 04:21:51.685853 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 14/39] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:51 2022] GET /compute/v2.1/os-volumes/9a5a4959-809e-44db-97c1-263f51f4b75d => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:21:51.692101 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1555366806", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:21:51.724562 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e76592ea-016a-45cb-9733-2658dacf0fd5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1215 microversion: 2.1 time: 0.379195 Jul 27 04:21:51.725179 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 26/40] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:51 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1215 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:51.737227 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-66a4296c-01ed-4434-8309-44396292ca3d tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] Calling method '.version_select at 0x7f21d78dd820>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:51.799499 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] validate_networks() for [('9b6659b1-b144-4a0f-8066-b48287eea6b5', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:21:51.972873 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-66a4296c-01ed-4434-8309-44396292ca3d tempest-VolumesTestJSON-1292159563 tempest-VolumesTestJSON-1292159563-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.245937 Jul 27 04:21:51.973493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 27/41] 10.222.0.46 () {58 vars in 1155 bytes} [Wed Jul 27 04:21:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:52.747177 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a9521625-7f9d-4c4e-aec1-5f33756b0b50 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:52.748120 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a9521625-7f9d-4c4e-aec1-5f33756b0b50 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:52.767801 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a9521625-7f9d-4c4e-aec1-5f33756b0b50 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:52.768421 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a9521625-7f9d-4c4e-aec1-5f33756b0b50 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:52.771400 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a9521625-7f9d-4c4e-aec1-5f33756b0b50 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:52.772425 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a9521625-7f9d-4c4e-aec1-5f33756b0b50 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:52.928822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:21:52.929319 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:21:52.930045 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:21:52.930467 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:21:52.930887 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:21:52.960633 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:52.961033 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:52.967981 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:52.968394 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:53.035192 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Getting quotas for project 5bb7f3d2bc1e4651b7f1e0ac6debd89a. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:21:53.050040 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Getting quotas for user 5a69202d87094049b12765d64c17e515 and project 5bb7f3d2bc1e4651b7f1e0ac6debd89a. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:21:53.100339 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:21:53.109167 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:21:53.156652 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a9521625-7f9d-4c4e-aec1-5f33756b0b50 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:21:53.185165 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a9521625-7f9d-4c4e-aec1-5f33756b0b50 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1219 microversion: 2.1 time: 0.442003 Jul 27 04:21:53.189793 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 28/42] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:52 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1219 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:53.219560 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9d76fa78-98c6-46ad-ac05-e9f555a0dfe7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.532459 Jul 27 04:21:53.232150 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 15/43] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:21:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:21:53.244000 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-efb1943d-431a-4759-af26-c341a5a48f61 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:53.246095 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-efb1943d-431a-4759-af26-c341a5a48f61 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:53.419303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-efb1943d-431a-4759-af26-c341a5a48f61 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:21:53.439150 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-efb1943d-431a-4759-af26-c341a5a48f61 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1222 microversion: 2.1 time: 0.199276 Jul 27 04:21:53.464752 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 29/44] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:53 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1222 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:54.211392 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-cbab9640-a7a1-460f-a812-fd3f407b2401 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:54.212077 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-cbab9640-a7a1-460f-a812-fd3f407b2401 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:54.221304 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cbab9640-a7a1-460f-a812-fd3f407b2401 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:54.222009 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cbab9640-a7a1-460f-a812-fd3f407b2401 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:54.222984 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cbab9640-a7a1-460f-a812-fd3f407b2401 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:54.223591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cbab9640-a7a1-460f-a812-fd3f407b2401 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:54.473904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-13635f5f-3ea4-471b-a1c6-ae0c18e4429c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:54.475054 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-13635f5f-3ea4-471b-a1c6-ae0c18e4429c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:54.491700 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-13635f5f-3ea4-471b-a1c6-ae0c18e4429c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:54.492221 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-13635f5f-3ea4-471b-a1c6-ae0c18e4429c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:54.500993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-13635f5f-3ea4-471b-a1c6-ae0c18e4429c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:54.504419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-13635f5f-3ea4-471b-a1c6-ae0c18e4429c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:54.631480 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-cbab9640-a7a1-460f-a812-fd3f407b2401 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:21:54.668274 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-cbab9640-a7a1-460f-a812-fd3f407b2401 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1267 microversion: 2.1 time: 0.460099 Jul 27 04:21:54.671423 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 16/45] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:54 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1267 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:55.065143 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-13635f5f-3ea4-471b-a1c6-ae0c18e4429c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:21:55.080055 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-13635f5f-3ea4-471b-a1c6-ae0c18e4429c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1226 microversion: 2.1 time: 0.609967 Jul 27 04:21:55.083016 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 30/46] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:54 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1226 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:21:55.695158 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4d994c39-be42-4576-abc2-d0aba6a6b433 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:55.695780 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4d994c39-be42-4576-abc2-d0aba6a6b433 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:55.702369 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d994c39-be42-4576-abc2-d0aba6a6b433 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:55.703121 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d994c39-be42-4576-abc2-d0aba6a6b433 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:55.704077 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d994c39-be42-4576-abc2-d0aba6a6b433 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:55.704737 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d994c39-be42-4576-abc2-d0aba6a6b433 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:55.786860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4d994c39-be42-4576-abc2-d0aba6a6b433 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:21:55.795809 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4d994c39-be42-4576-abc2-d0aba6a6b433 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1273 microversion: 2.1 time: 0.104618 Jul 27 04:21:55.810823 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 31/47] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:55 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:56.007795 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6cf69481-28ed-4f3f-80b8-e10ab992b706 tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] Action: 'create', calling method: .version_select at 0x7f21d6875670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1193075617", "metadata": {"Type": "work"}}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:21:56.105185 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7d8c78ce-ac4f-4bf4-aa3c-13bc88d99e34 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:56.106089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-7d8c78ce-ac4f-4bf4-aa3c-13bc88d99e34 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:56.115515 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7d8c78ce-ac4f-4bf4-aa3c-13bc88d99e34 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:56.116248 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7d8c78ce-ac4f-4bf4-aa3c-13bc88d99e34 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:56.118682 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7d8c78ce-ac4f-4bf4-aa3c-13bc88d99e34 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:56.121235 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7d8c78ce-ac4f-4bf4-aa3c-13bc88d99e34 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:56.228440 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-7d8c78ce-ac4f-4bf4-aa3c-13bc88d99e34 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:21:56.243848 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-7d8c78ce-ac4f-4bf4-aa3c-13bc88d99e34 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1274 microversion: 2.1 time: 0.142813 Jul 27 04:21:56.246423 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 32/48] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:56 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1274 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:56.515443 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6cf69481-28ed-4f3f-80b8-e10ab992b706 tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.856582 Jul 27 04:21:56.516408 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 17/49] 10.222.0.46 () {60 vars in 1156 bytes} [Wed Jul 27 04:21:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 858 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 27 04:21:56.529439 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-29853e2f-744d-4109-acd1-00162093f948 tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] Calling method '.version_select at 0x7f21d67eaaf0>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:56.610707 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-29853e2f-744d-4109-acd1-00162093f948 tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f" status: 200 len: 353 microversion: 2.1 time: 0.085474 Jul 27 04:21:56.611775 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 33/50] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:56 2022] GET /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:21:56.820943 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b71e26d5-55d0-4bbb-aa85-c927a29f48b5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:56.821637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-b71e26d5-55d0-4bbb-aa85-c927a29f48b5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:56.833514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b71e26d5-55d0-4bbb-aa85-c927a29f48b5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:56.834162 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b71e26d5-55d0-4bbb-aa85-c927a29f48b5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:56.835282 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b71e26d5-55d0-4bbb-aa85-c927a29f48b5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:56.835891 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b71e26d5-55d0-4bbb-aa85-c927a29f48b5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:56.903377 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-b71e26d5-55d0-4bbb-aa85-c927a29f48b5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:21:56.911018 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-b71e26d5-55d0-4bbb-aa85-c927a29f48b5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1273 microversion: 2.1 time: 0.095942 Jul 27 04:21:56.911856 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 18/51] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:56 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1273 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:57.270713 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-fe83e893-8041-4a9d-9830-5074924225f5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:57.271326 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-fe83e893-8041-4a9d-9830-5074924225f5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:57.277403 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fe83e893-8041-4a9d-9830-5074924225f5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:57.277844 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fe83e893-8041-4a9d-9830-5074924225f5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:57.278646 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fe83e893-8041-4a9d-9830-5074924225f5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:57.279078 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fe83e893-8041-4a9d-9830-5074924225f5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:57.342992 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-fe83e893-8041-4a9d-9830-5074924225f5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:21:57.350264 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-fe83e893-8041-4a9d-9830-5074924225f5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1274 microversion: 2.1 time: 0.084191 Jul 27 04:21:57.350930 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 34/52] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:57 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:57.625934 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-cf0c06c6-5dd0-4240-9a4f-c7c8fe9145bc tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] Calling method '.version_select at 0x7f21d681d280>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:57.675506 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-cf0c06c6-5dd0-4240-9a4f-c7c8fe9145bc tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f" status: 200 len: 353 microversion: 2.1 time: 0.053504 Jul 27 04:21:57.676166 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 19/53] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:57 2022] GET /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:57.934938 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-23ca876e-e239-4385-85a6-ab441d37588e tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:57.935845 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-23ca876e-e239-4385-85a6-ab441d37588e tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:57.944586 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-23ca876e-e239-4385-85a6-ab441d37588e tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:57.945496 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-23ca876e-e239-4385-85a6-ab441d37588e tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:57.946923 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-23ca876e-e239-4385-85a6-ab441d37588e tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:57.947565 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-23ca876e-e239-4385-85a6-ab441d37588e tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:58.027635 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-23ca876e-e239-4385-85a6-ab441d37588e tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:21:58.036153 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-23ca876e-e239-4385-85a6-ab441d37588e tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1273 microversion: 2.1 time: 0.107358 Jul 27 04:21:58.036925 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 35/54] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:57 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:58.371552 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7f2528d0-eb14-4435-9d10-4bab3b73f2aa tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:58.372493 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-7f2528d0-eb14-4435-9d10-4bab3b73f2aa tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:58.387522 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7f2528d0-eb14-4435-9d10-4bab3b73f2aa tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:58.391702 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7f2528d0-eb14-4435-9d10-4bab3b73f2aa tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:58.392644 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7f2528d0-eb14-4435-9d10-4bab3b73f2aa tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:58.395426 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7f2528d0-eb14-4435-9d10-4bab3b73f2aa tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:58.620834 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-7f2528d0-eb14-4435-9d10-4bab3b73f2aa tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:21:58.628889 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-7f2528d0-eb14-4435-9d10-4bab3b73f2aa tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1282 microversion: 2.1 time: 0.261771 Jul 27 04:21:58.629653 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 20/55] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:58 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1282 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:21:58.704665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8d8f7c7f-6d4b-43fe-b595-8d289e96cdbf tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] Calling method '.version_select at 0x7f21d6816820>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:58.993676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8d8f7c7f-6d4b-43fe-b595-8d289e96cdbf tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f" status: 200 len: 354 microversion: 2.1 time: 0.306319 Jul 27 04:21:58.995285 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 36/56] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:58 2022] GET /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f => generated 354 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:59.007829 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f7a4b4ac-664f-4d4f-b521-865a4007f1f9 tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] Calling method '.version_select at 0x7f21d67fa5e0>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:59.058517 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1d1556fd-325b-4266-a77b-e537a57c4ad0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:59.059316 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-1d1556fd-325b-4266-a77b-e537a57c4ad0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:59.079961 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1d1556fd-325b-4266-a77b-e537a57c4ad0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:59.080656 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1d1556fd-325b-4266-a77b-e537a57c4ad0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:59.081595 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1d1556fd-325b-4266-a77b-e537a57c4ad0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:59.082402 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1d1556fd-325b-4266-a77b-e537a57c4ad0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:59.222215 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f7a4b4ac-664f-4d4f-b521-865a4007f1f9 tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f" status: 200 len: 354 microversion: 2.1 time: 0.218215 Jul 27 04:21:59.222796 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 21/57] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:59 2022] GET /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f => generated 354 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:59.252053 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ef6e9629-ba5d-43b2-9cce-390ee6b7e54f tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] Calling method '.version_select at 0x7f21d67fa670>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:59.426144 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ef6e9629-ba5d-43b2-9cce-390ee6b7e54f tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f" status: 202 len: 0 microversion: 2.1 time: 0.183908 Jul 27 04:21:59.431075 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 22/58] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Jul 27 04:21:59 2022] DELETE /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:21:59.438084 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-427da94a-ca22-47bf-9409-0043ad57e1f1 tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] Calling method '.version_select at 0x7f21d67b49d0>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:59.545343 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-427da94a-ca22-47bf-9409-0043ad57e1f1 tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f" status: 200 len: 353 microversion: 2.1 time: 0.111909 Jul 27 04:21:59.546405 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 23/59] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:21:59 2022] GET /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:21:59.653476 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-18200713-cbc9-47e2-9413-a36dd8e7452b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:21:59.654147 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-18200713-cbc9-47e2-9413-a36dd8e7452b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:21:59.670878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-18200713-cbc9-47e2-9413-a36dd8e7452b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:59.673079 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-18200713-cbc9-47e2-9413-a36dd8e7452b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:59.676724 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-18200713-cbc9-47e2-9413-a36dd8e7452b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:21:59.680510 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-18200713-cbc9-47e2-9413-a36dd8e7452b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:21:59.781247 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-1d1556fd-325b-4266-a77b-e537a57c4ad0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:21:59.812634 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-1d1556fd-325b-4266-a77b-e537a57c4ad0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.758966 Jul 27 04:21:59.817612 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 37/60] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:59 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:00.433823 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-18200713-cbc9-47e2-9413-a36dd8e7452b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:00.453222 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-18200713-cbc9-47e2-9413-a36dd8e7452b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1280 microversion: 2.1 time: 0.804971 Jul 27 04:22:00.482052 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 24/61] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:21:59 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1280 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:22:00.565346 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9734e2cf-bf3a-4886-9bfb-0b332554c753 tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] Calling method '.version_select at 0x7f21d67ea9d0>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:00.638472 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-9734e2cf-bf3a-4886-9bfb-0b332554c753 tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] HTTP exception thrown: Volume 310e2d15-d1e9-4cbe-895a-7201bd13fc2f could not be found. Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9734e2cf-bf3a-4886-9bfb-0b332554c753 tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] Request method failure captured: Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f HTTP/1.1 Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L1jwJVPNQPuwStiW6ZXSxHNGZvAt7j25allh96mR4loMe_nW-Vw1JHYBNMGfz4nNIYPMsSO7duyhU3tZtYPd8pMaOT4T4lRvdPvnubF538h-Y7qRTzykmWjgL5HEbz7uDwcRQ1iqwtBfU3WExdnlths2ApTGMyUmyHdNdYb3mDNgsY Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 04b921e9d954424f9c1822e2fc77e36e Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-VolumesGetTestJSON-1455892536 Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:22:00.641710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:22:00.643059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/04b921e9d954424f9c1822e2fc77e36e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04b921e9d954424f9c1822e2fc77e36e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04b921e9d954424f9c1822e2fc77e36e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_04b921e9d954424f9c1822e2fc77e36e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:22:00.643059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-VolumesGetTestJSON-1455892536 Jul 27 04:22:00.643059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 04b921e9d954424f9c1822e2fc77e36e Jul 27 04:22:00.643059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-VolumesGetTestJSON-1455892536 Jul 27 04:22:00.643059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-VolumesGetTestJSON-1455892536-project Jul 27 04:22:00.643059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:22:00.643059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:22:00.643059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 827504a764024c91ad266804b7b2e162 Jul 27 04:22:00.643059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-VolumesGetTestJSON-1455892536-project Jul 27 04:22:00.643059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: Jul 27 04:22:00.643059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Volume 310e2d15-d1e9-4cbe-895a-7201bd13fc2f could not be found. Jul 27 04:22:00.643059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '310e2d15-d1e9-4cbe-895a-7201bd13fc2f'} Jul 27 04:22:00.643059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 310e2d15-d1e9-4cbe-895a-7201bd13fc2f could not be found. (HTTP 404) (Request-ID: req-440be198-fccc-4732-bae1-3c13d2c366be) Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:22:00.643880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 04:22:00.645042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 310e2d15-d1e9-4cbe-895a-7201bd13fc2f could not be found. Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 04:22:00.646204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:22:00.647970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 310e2d15-d1e9-4cbe-895a-7201bd13fc2f could not be found. Jul 27 04:22:00.647970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:22:00.647970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:22:00.647970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:22:00.647970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:22:00.647970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:22:00.647970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:22:00.647970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:22:00.647970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:22:00.647970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 310e2d15-d1e9-4cbe-895a-7201bd13fc2f could not be found. Jul 27 04:22:00.647970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:22:00.647970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9734e2cf-bf3a-4886-9bfb-0b332554c753 tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] Returning 404 to user: Volume 310e2d15-d1e9-4cbe-895a-7201bd13fc2f could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:22:00.647970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-9734e2cf-bf3a-4886-9bfb-0b332554c753 tempest-VolumesGetTestJSON-1455892536 tempest-VolumesGetTestJSON-1455892536-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f" status: 404 len: 109 microversion: 2.1 time: 0.090006 Jul 27 04:22:00.653209 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 38/62] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Jul 27 04:22:00 2022] GET /compute/v2.1/os-volumes/310e2d15-d1e9-4cbe-895a-7201bd13fc2f => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:22:00.836633 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0a8e6133-d574-4456-ba07-2db8fdb71b6f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:00.838166 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0a8e6133-d574-4456-ba07-2db8fdb71b6f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:00.860638 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0a8e6133-d574-4456-ba07-2db8fdb71b6f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:00.861618 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0a8e6133-d574-4456-ba07-2db8fdb71b6f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:00.865168 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0a8e6133-d574-4456-ba07-2db8fdb71b6f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:00.866671 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0a8e6133-d574-4456-ba07-2db8fdb71b6f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:01.265100 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-0a8e6133-d574-4456-ba07-2db8fdb71b6f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:01.273640 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0a8e6133-d574-4456-ba07-2db8fdb71b6f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.442481 Jul 27 04:22:01.274724 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 25/63] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:00 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:01.476648 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:01.484767 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a0a4d6e5-7e6e-41ad-a0f6-462847eb9d5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:01.487147 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a0a4d6e5-7e6e-41ad-a0f6-462847eb9d5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:01.505847 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a0a4d6e5-7e6e-41ad-a0f6-462847eb9d5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:01.506391 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a0a4d6e5-7e6e-41ad-a0f6-462847eb9d5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:01.508114 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a0a4d6e5-7e6e-41ad-a0f6-462847eb9d5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:01.514358 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a0a4d6e5-7e6e-41ad-a0f6-462847eb9d5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:01.763427 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a0a4d6e5-7e6e-41ad-a0f6-462847eb9d5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:01.776295 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a0a4d6e5-7e6e-41ad-a0f6-462847eb9d5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.300167 Jul 27 04:22:01.797044 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 39/64] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:01 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:02.295844 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-1ba934f7-6699-47b6-81ad-258cb386c4de tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:02.297357 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-1ba934f7-6699-47b6-81ad-258cb386c4de tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:02.314717 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1ba934f7-6699-47b6-81ad-258cb386c4de tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:02.315590 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1ba934f7-6699-47b6-81ad-258cb386c4de tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:02.318328 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1ba934f7-6699-47b6-81ad-258cb386c4de tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:02.318966 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1ba934f7-6699-47b6-81ad-258cb386c4de tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:02.594946 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-1ba934f7-6699-47b6-81ad-258cb386c4de tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:02.609668 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-1ba934f7-6699-47b6-81ad-258cb386c4de tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.318472 Jul 27 04:22:02.611041 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 26/65] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:02 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:02.825848 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a6c01ab2-f054-42ab-9845-c010b358188e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:02.828023 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a6c01ab2-f054-42ab-9845-c010b358188e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:02.848074 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a6c01ab2-f054-42ab-9845-c010b358188e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:02.865352 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a6c01ab2-f054-42ab-9845-c010b358188e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:02.872961 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a6c01ab2-f054-42ab-9845-c010b358188e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:02.873754 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a6c01ab2-f054-42ab-9845-c010b358188e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:02.991871 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=4 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:03.078652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=14 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:03.147900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-a63f9196-8186-4ae5-9945-01f1ed240cc6 req-bdc7e69e-72d6-4a1b-bca2-8994756d5542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9878f853-653a-4dbc-beb5-e1191e7c3e5f", "tag": "32e0b1d6-6e4d-40a3-8ab0-ac75771d2bfc"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:22:03.177633 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-a63f9196-8186-4ae5-9945-01f1ed240cc6 req-bdc7e69e-72d6-4a1b-bca2-8994756d5542 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:03.179909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-a63f9196-8186-4ae5-9945-01f1ed240cc6 req-bdc7e69e-72d6-4a1b-bca2-8994756d5542 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:03.184327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a6c01ab2-f054-42ab-9845-c010b358188e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:03.213641 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a6c01ab2-f054-42ab-9845-c010b358188e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.410225 Jul 27 04:22:03.228071 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 40/66] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:02 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:03.232736 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-a63f9196-8186-4ae5-9945-01f1ed240cc6 req-bdc7e69e-72d6-4a1b-bca2-8994756d5542 service nova] Creating event network-changed:32e0b1d6-6e4d-40a3-8ab0-ac75771d2bfc for instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f on hv-cinder-85098 Jul 27 04:22:03.234422 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-a63f9196-8186-4ae5-9945-01f1ed240cc6 req-bdc7e69e-72d6-4a1b-bca2-8994756d5542 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117739) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 04:22:03.236632 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-99e13718-935b-43d2-8b93-a0b46b4c0c21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:03.237498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-99e13718-935b-43d2-8b93-a0b46b4c0c21 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:03.239748 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-99e13718-935b-43d2-8b93-a0b46b4c0c21 None None] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:03.240948 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-99e13718-935b-43d2-8b93-a0b46b4c0c21 None None] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:03.259172 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.compute.rpcapi [None req-99e13718-935b-43d2-8b93-a0b46b4c0c21 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 04:22:03.260939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-99e13718-935b-43d2-8b93-a0b46b4c0c21 None None] Releasing lock "compute-rpcapi-router" {{(pid=117739) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 04:22:03.303074 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-99e13718-935b-43d2-8b93-a0b46b4c0c21 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.412090 Jul 27 04:22:03.304057 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 27/67] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:22:03.630291 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-5270df03-25c5-4029-921d-d3e9206ccbbd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:03.631220 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-5270df03-25c5-4029-921d-d3e9206ccbbd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:03.633580 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=10 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:03.640847 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5270df03-25c5-4029-921d-d3e9206ccbbd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:03.641250 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5270df03-25c5-4029-921d-d3e9206ccbbd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:03.642155 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5270df03-25c5-4029-921d-d3e9206ccbbd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:03.642593 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5270df03-25c5-4029-921d-d3e9206ccbbd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:03.848415 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-5270df03-25c5-4029-921d-d3e9206ccbbd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:03.889837 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-5270df03-25c5-4029-921d-d3e9206ccbbd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.263356 Jul 27 04:22:03.891184 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 41/68] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:03 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:04.242393 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5bcc6e59-0ef1-4d07-a8e3-2d2705c99a28 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:04.243345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-5bcc6e59-0ef1-4d07-a8e3-2d2705c99a28 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:04.255167 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5bcc6e59-0ef1-4d07-a8e3-2d2705c99a28 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:04.258258 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5bcc6e59-0ef1-4d07-a8e3-2d2705c99a28 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:04.263287 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5bcc6e59-0ef1-4d07-a8e3-2d2705c99a28 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:04.266305 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5bcc6e59-0ef1-4d07-a8e3-2d2705c99a28 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:04.517450 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-5bcc6e59-0ef1-4d07-a8e3-2d2705c99a28 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:04.528632 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-5bcc6e59-0ef1-4d07-a8e3-2d2705c99a28 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.290858 Jul 27 04:22:04.529594 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 28/69] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:04 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:04.914866 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d6d74d17-1fb6-4d2e-b7f9-5019e032ce93 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:04.915501 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d6d74d17-1fb6-4d2e-b7f9-5019e032ce93 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:04.951585 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d6d74d17-1fb6-4d2e-b7f9-5019e032ce93 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:04.954770 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d6d74d17-1fb6-4d2e-b7f9-5019e032ce93 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:04.955609 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d6d74d17-1fb6-4d2e-b7f9-5019e032ce93 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:04.956412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d6d74d17-1fb6-4d2e-b7f9-5019e032ce93 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:05.234260 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d6d74d17-1fb6-4d2e-b7f9-5019e032ce93 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:05.244262 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d6d74d17-1fb6-4d2e-b7f9-5019e032ce93 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.333368 Jul 27 04:22:05.253185 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 42/70] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:04 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:05.553041 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c4868125-96dd-471d-bdf7-b5639ea72f42 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:05.553799 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c4868125-96dd-471d-bdf7-b5639ea72f42 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:05.568448 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c4868125-96dd-471d-bdf7-b5639ea72f42 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:05.569034 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c4868125-96dd-471d-bdf7-b5639ea72f42 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:05.570196 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c4868125-96dd-471d-bdf7-b5639ea72f42 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:05.570783 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c4868125-96dd-471d-bdf7-b5639ea72f42 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:05.794113 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c4868125-96dd-471d-bdf7-b5639ea72f42 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:05.809277 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c4868125-96dd-471d-bdf7-b5639ea72f42 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.260334 Jul 27 04:22:05.819780 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 29/71] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:05 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:06.268402 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-5ab39904-fc3e-4c45-8343-5d44da7dcaf1 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:06.269139 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-5ab39904-fc3e-4c45-8343-5d44da7dcaf1 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:06.277744 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ab39904-fc3e-4c45-8343-5d44da7dcaf1 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:06.278330 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ab39904-fc3e-4c45-8343-5d44da7dcaf1 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:06.279206 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ab39904-fc3e-4c45-8343-5d44da7dcaf1 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:06.279738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ab39904-fc3e-4c45-8343-5d44da7dcaf1 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:06.530769 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-5ab39904-fc3e-4c45-8343-5d44da7dcaf1 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:06.539795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-5ab39904-fc3e-4c45-8343-5d44da7dcaf1 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.275670 Jul 27 04:22:06.561789 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 43/72] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:06 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:06.831712 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-fc97ba2b-7fbd-4711-bc54-ed74426b767f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:06.833201 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-fc97ba2b-7fbd-4711-bc54-ed74426b767f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:06.842087 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fc97ba2b-7fbd-4711-bc54-ed74426b767f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:06.842987 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fc97ba2b-7fbd-4711-bc54-ed74426b767f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:06.843892 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fc97ba2b-7fbd-4711-bc54-ed74426b767f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:06.844550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fc97ba2b-7fbd-4711-bc54-ed74426b767f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:07.054916 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-fc97ba2b-7fbd-4711-bc54-ed74426b767f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:07.065934 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-fc97ba2b-7fbd-4711-bc54-ed74426b767f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.237932 Jul 27 04:22:07.082257 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 30/73] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:06 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:07.561460 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ccc56988-de2b-466e-abc4-1041b221b0bd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:07.562689 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ccc56988-de2b-466e-abc4-1041b221b0bd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:07.578164 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ccc56988-de2b-466e-abc4-1041b221b0bd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:07.580275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ccc56988-de2b-466e-abc4-1041b221b0bd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:07.583345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ccc56988-de2b-466e-abc4-1041b221b0bd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:07.584036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ccc56988-de2b-466e-abc4-1041b221b0bd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:07.841359 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ccc56988-de2b-466e-abc4-1041b221b0bd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:07.851302 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ccc56988-de2b-466e-abc4-1041b221b0bd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.294327 Jul 27 04:22:07.867144 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 44/74] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:07 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:08.093595 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-cd287304-ac4a-4985-822e-076074df7990 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:08.094947 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-cd287304-ac4a-4985-822e-076074df7990 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:08.111160 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cd287304-ac4a-4985-822e-076074df7990 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:08.111741 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cd287304-ac4a-4985-822e-076074df7990 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:08.116959 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cd287304-ac4a-4985-822e-076074df7990 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:08.117599 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cd287304-ac4a-4985-822e-076074df7990 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:08.393884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-cd287304-ac4a-4985-822e-076074df7990 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:08.403525 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-cd287304-ac4a-4985-822e-076074df7990 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.318576 Jul 27 04:22:08.405272 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 31/75] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:08 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:08.878089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9e05a4e5-dc86-4f7e-802b-cd26b1e141db tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:08.880685 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-9e05a4e5-dc86-4f7e-802b-cd26b1e141db tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:08.893094 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9e05a4e5-dc86-4f7e-802b-cd26b1e141db tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:08.893476 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9e05a4e5-dc86-4f7e-802b-cd26b1e141db tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:08.894391 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9e05a4e5-dc86-4f7e-802b-cd26b1e141db tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:08.896100 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9e05a4e5-dc86-4f7e-802b-cd26b1e141db tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:09.128138 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-9e05a4e5-dc86-4f7e-802b-cd26b1e141db tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:09.137766 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-9e05a4e5-dc86-4f7e-802b-cd26b1e141db tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.265596 Jul 27 04:22:09.137962 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 45/76] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:08 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:09.441334 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-348fce2f-538d-4924-a3fb-93f00a4236cd tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:09.441955 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-348fce2f-538d-4924-a3fb-93f00a4236cd tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:09.454346 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-348fce2f-538d-4924-a3fb-93f00a4236cd tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:09.454962 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-348fce2f-538d-4924-a3fb-93f00a4236cd tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:09.456763 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-348fce2f-538d-4924-a3fb-93f00a4236cd tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:09.457193 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-348fce2f-538d-4924-a3fb-93f00a4236cd tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:09.696622 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-348fce2f-538d-4924-a3fb-93f00a4236cd tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:09.704774 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-348fce2f-538d-4924-a3fb-93f00a4236cd tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.267357 Jul 27 04:22:09.705348 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 32/77] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:09 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:10.162777 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e8b9afa2-8440-4c44-bc45-f184c6ed2f8a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:10.163711 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e8b9afa2-8440-4c44-bc45-f184c6ed2f8a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:10.174425 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e8b9afa2-8440-4c44-bc45-f184c6ed2f8a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:10.175034 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e8b9afa2-8440-4c44-bc45-f184c6ed2f8a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:10.175821 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e8b9afa2-8440-4c44-bc45-f184c6ed2f8a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:10.176266 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e8b9afa2-8440-4c44-bc45-f184c6ed2f8a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:10.322887 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e8b9afa2-8440-4c44-bc45-f184c6ed2f8a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:10.331276 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e8b9afa2-8440-4c44-bc45-f184c6ed2f8a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.173339 Jul 27 04:22:10.331845 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 46/78] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:10 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:10.724407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-37d89d33-3405-425f-9b51-8acc736a5573 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:10.724952 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-37d89d33-3405-425f-9b51-8acc736a5573 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:10.731030 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-37d89d33-3405-425f-9b51-8acc736a5573 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:10.731469 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-37d89d33-3405-425f-9b51-8acc736a5573 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:10.732220 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-37d89d33-3405-425f-9b51-8acc736a5573 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:10.732647 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-37d89d33-3405-425f-9b51-8acc736a5573 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:10.856526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-37d89d33-3405-425f-9b51-8acc736a5573 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:10.863888 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-37d89d33-3405-425f-9b51-8acc736a5573 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.143379 Jul 27 04:22:10.864456 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 33/79] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:10 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:11.352449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-395edf70-4b50-4972-916c-0c8d0ccccc9a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:11.353056 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-395edf70-4b50-4972-916c-0c8d0ccccc9a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:11.359645 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-395edf70-4b50-4972-916c-0c8d0ccccc9a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:11.360078 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-395edf70-4b50-4972-916c-0c8d0ccccc9a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:11.360861 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-395edf70-4b50-4972-916c-0c8d0ccccc9a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:11.361287 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-395edf70-4b50-4972-916c-0c8d0ccccc9a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:11.488795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-395edf70-4b50-4972-916c-0c8d0ccccc9a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:11.496935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-395edf70-4b50-4972-916c-0c8d0ccccc9a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.148302 Jul 27 04:22:11.497500 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 47/80] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:11 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:11.885547 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-bba0097c-a063-4aaf-b4f3-1fb74d088e1a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:11.886183 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-bba0097c-a063-4aaf-b4f3-1fb74d088e1a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:11.892443 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bba0097c-a063-4aaf-b4f3-1fb74d088e1a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:11.892883 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bba0097c-a063-4aaf-b4f3-1fb74d088e1a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:11.893642 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bba0097c-a063-4aaf-b4f3-1fb74d088e1a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:11.894110 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bba0097c-a063-4aaf-b4f3-1fb74d088e1a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:12.027302 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-bba0097c-a063-4aaf-b4f3-1fb74d088e1a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:12.034629 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-bba0097c-a063-4aaf-b4f3-1fb74d088e1a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.153156 Jul 27 04:22:12.035196 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 34/81] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:11 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:12.517459 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c11cdbc9-f34d-45da-857c-bebedf729af7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:12.518249 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c11cdbc9-f34d-45da-857c-bebedf729af7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:12.530858 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c11cdbc9-f34d-45da-857c-bebedf729af7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:12.531575 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c11cdbc9-f34d-45da-857c-bebedf729af7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:12.532516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c11cdbc9-f34d-45da-857c-bebedf729af7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:12.533995 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c11cdbc9-f34d-45da-857c-bebedf729af7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:12.547314 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=100 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:12.949266 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-c11cdbc9-f34d-45da-857c-bebedf729af7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:12.971977 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c11cdbc9-f34d-45da-857c-bebedf729af7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.457010 Jul 27 04:22:12.972565 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 48/82] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:12 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:13.055415 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c0589a5e-ce1f-403c-9712-4f7738980291 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:13.057163 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c0589a5e-ce1f-403c-9712-4f7738980291 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:13.064097 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c0589a5e-ce1f-403c-9712-4f7738980291 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:13.064623 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c0589a5e-ce1f-403c-9712-4f7738980291 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:13.065781 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c0589a5e-ce1f-403c-9712-4f7738980291 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:13.067493 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c0589a5e-ce1f-403c-9712-4f7738980291 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:13.255766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:13.431256 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c0589a5e-ce1f-403c-9712-4f7738980291 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:13.446313 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c0589a5e-ce1f-403c-9712-4f7738980291 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.394461 Jul 27 04:22:13.447982 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 35/83] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:13 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:13.610055 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-4abce6bb-7155-45c4-bae1-8d2108766b02 req-de22b9a8-aa4a-4aca-9adc-71de0f8ba77c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c", "tag": "a40f4c5b-77ca-4a0a-a4d4-f5f9a5b1014f"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:22:13.623092 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-4abce6bb-7155-45c4-bae1-8d2108766b02 req-de22b9a8-aa4a-4aca-9adc-71de0f8ba77c service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:13.623533 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-4abce6bb-7155-45c4-bae1-8d2108766b02 req-de22b9a8-aa4a-4aca-9adc-71de0f8ba77c service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:13.643973 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-4abce6bb-7155-45c4-bae1-8d2108766b02 req-de22b9a8-aa4a-4aca-9adc-71de0f8ba77c service nova] Creating event network-changed:a40f4c5b-77ca-4a0a-a4d4-f5f9a5b1014f for instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c on hv-cinder-85098 Jul 27 04:22:13.644506 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-4abce6bb-7155-45c4-bae1-8d2108766b02 req-de22b9a8-aa4a-4aca-9adc-71de0f8ba77c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117740) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 04:22:13.647263 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-560adaef-6810-4ad4-b01d-0cc4cf11d40d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:13.647714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-560adaef-6810-4ad4-b01d-0cc4cf11d40d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:13.648512 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-560adaef-6810-4ad4-b01d-0cc4cf11d40d None None] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:13.648945 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-560adaef-6810-4ad4-b01d-0cc4cf11d40d None None] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:13.674496 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-f7b6461a-5e49-4cf6-9a75-f85da13eca91 req-9957ae73-535c-40f4-82b5-aaeb2764cc4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "259425f9-0ddb-4181-8639-9b3446d21d80", "tag": "7e7ba03c-2d08-4012-8a46-6bae711cc6e3"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:22:13.686927 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.compute.rpcapi [None req-560adaef-6810-4ad4-b01d-0cc4cf11d40d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 04:22:13.687827 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-560adaef-6810-4ad4-b01d-0cc4cf11d40d None None] Releasing lock "compute-rpcapi-router" {{(pid=117740) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 04:22:13.691274 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-f7b6461a-5e49-4cf6-9a75-f85da13eca91 req-9957ae73-535c-40f4-82b5-aaeb2764cc4a service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:13.692143 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-f7b6461a-5e49-4cf6-9a75-f85da13eca91 req-9957ae73-535c-40f4-82b5-aaeb2764cc4a service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:13.710753 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-f7b6461a-5e49-4cf6-9a75-f85da13eca91 req-9957ae73-535c-40f4-82b5-aaeb2764cc4a service nova] Creating event network-changed:7e7ba03c-2d08-4012-8a46-6bae711cc6e3 for instance 259425f9-0ddb-4181-8639-9b3446d21d80 on hv-cinder-85098 Jul 27 04:22:13.719857 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-f7b6461a-5e49-4cf6-9a75-f85da13eca91 req-9957ae73-535c-40f4-82b5-aaeb2764cc4a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051224 Jul 27 04:22:13.720653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-560adaef-6810-4ad4-b01d-0cc4cf11d40d None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189360 Jul 27 04:22:13.721811 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 49/85] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:22:13.721924 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 36/85] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:22:14.002972 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5078d428-a132-4b9d-ba74-829c98da0def tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:14.003810 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-5078d428-a132-4b9d-ba74-829c98da0def tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:14.011377 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5078d428-a132-4b9d-ba74-829c98da0def tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:14.011820 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5078d428-a132-4b9d-ba74-829c98da0def tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:14.012580 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5078d428-a132-4b9d-ba74-829c98da0def tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:14.013151 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5078d428-a132-4b9d-ba74-829c98da0def tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:14.169743 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-5078d428-a132-4b9d-ba74-829c98da0def tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:14.175162 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=100 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:14.180135 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-5078d428-a132-4b9d-ba74-829c98da0def tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.189726 Jul 27 04:22:14.180789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 37/86] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:13 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:14.468692 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-44944ef4-b306-4573-893d-a7dcf76a112f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:14.469379 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-44944ef4-b306-4573-893d-a7dcf76a112f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:14.475683 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-44944ef4-b306-4573-893d-a7dcf76a112f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:14.476122 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-44944ef4-b306-4573-893d-a7dcf76a112f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:14.476881 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-44944ef4-b306-4573-893d-a7dcf76a112f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:14.477308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-44944ef4-b306-4573-893d-a7dcf76a112f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:14.611871 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-44944ef4-b306-4573-893d-a7dcf76a112f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:14.620098 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-44944ef4-b306-4573-893d-a7dcf76a112f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.155728 Jul 27 04:22:14.620669 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 50/87] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:14 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:15.201774 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-56fec333-2fa1-4a57-9cda-1cfcb0e47287 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:15.202521 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-56fec333-2fa1-4a57-9cda-1cfcb0e47287 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:15.210356 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-56fec333-2fa1-4a57-9cda-1cfcb0e47287 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:15.211042 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-56fec333-2fa1-4a57-9cda-1cfcb0e47287 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:15.212129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-56fec333-2fa1-4a57-9cda-1cfcb0e47287 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:15.213011 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-56fec333-2fa1-4a57-9cda-1cfcb0e47287 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:15.450857 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-56fec333-2fa1-4a57-9cda-1cfcb0e47287 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:15.473264 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-56fec333-2fa1-4a57-9cda-1cfcb0e47287 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.275716 Jul 27 04:22:15.474290 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 38/88] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:15 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:15.643873 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-62d8b3e8-91d0-4720-8a42-598f7a64c946 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:15.644568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-62d8b3e8-91d0-4720-8a42-598f7a64c946 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:15.655531 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-62d8b3e8-91d0-4720-8a42-598f7a64c946 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:15.656829 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-62d8b3e8-91d0-4720-8a42-598f7a64c946 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:15.658104 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-62d8b3e8-91d0-4720-8a42-598f7a64c946 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:15.658889 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-62d8b3e8-91d0-4720-8a42-598f7a64c946 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:16.118374 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-62d8b3e8-91d0-4720-8a42-598f7a64c946 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:16.129214 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-62d8b3e8-91d0-4720-8a42-598f7a64c946 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.490950 Jul 27 04:22:16.131302 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 51/89] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:15 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:16.495916 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6bef2458-d94f-4826-8a9a-a59c187dded7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:16.496524 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6bef2458-d94f-4826-8a9a-a59c187dded7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:16.504571 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6bef2458-d94f-4826-8a9a-a59c187dded7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:16.505022 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6bef2458-d94f-4826-8a9a-a59c187dded7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:16.509006 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6bef2458-d94f-4826-8a9a-a59c187dded7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:16.509663 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6bef2458-d94f-4826-8a9a-a59c187dded7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:16.690840 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6bef2458-d94f-4826-8a9a-a59c187dded7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:16.699421 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6bef2458-d94f-4826-8a9a-a59c187dded7 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.207648 Jul 27 04:22:16.702529 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 39/90] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:16 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:17.155174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7d7906bc-05b6-4c65-9f23-90b0fb620f52 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:17.155787 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-7d7906bc-05b6-4c65-9f23-90b0fb620f52 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:17.157725 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:17.164225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7d7906bc-05b6-4c65-9f23-90b0fb620f52 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:17.164908 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7d7906bc-05b6-4c65-9f23-90b0fb620f52 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:17.165704 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7d7906bc-05b6-4c65-9f23-90b0fb620f52 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:17.166170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7d7906bc-05b6-4c65-9f23-90b0fb620f52 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:17.325870 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-7d7906bc-05b6-4c65-9f23-90b0fb620f52 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:17.334337 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-7d7906bc-05b6-4c65-9f23-90b0fb620f52 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.183810 Jul 27 04:22:17.335109 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 52/91] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:17 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:17.723759 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4dc8182e-06a9-4e89-ae74-beea9e4fe922 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:17.724379 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4dc8182e-06a9-4e89-ae74-beea9e4fe922 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:17.726323 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:17.732178 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4dc8182e-06a9-4e89-ae74-beea9e4fe922 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:17.732625 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4dc8182e-06a9-4e89-ae74-beea9e4fe922 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:17.733388 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4dc8182e-06a9-4e89-ae74-beea9e4fe922 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:17.733820 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4dc8182e-06a9-4e89-ae74-beea9e4fe922 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:17.928081 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4dc8182e-06a9-4e89-ae74-beea9e4fe922 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:17.954349 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4dc8182e-06a9-4e89-ae74-beea9e4fe922 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.234459 Jul 27 04:22:17.954931 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 40/92] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:17 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:18.357054 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-57f9dfdf-4f76-4e7a-a3ec-fa3263af7e68 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:18.357768 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-57f9dfdf-4f76-4e7a-a3ec-fa3263af7e68 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:18.366133 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-57f9dfdf-4f76-4e7a-a3ec-fa3263af7e68 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:18.366579 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-57f9dfdf-4f76-4e7a-a3ec-fa3263af7e68 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:18.367358 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-57f9dfdf-4f76-4e7a-a3ec-fa3263af7e68 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:18.367764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-57f9dfdf-4f76-4e7a-a3ec-fa3263af7e68 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:18.509585 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-57f9dfdf-4f76-4e7a-a3ec-fa3263af7e68 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:18.517270 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-57f9dfdf-4f76-4e7a-a3ec-fa3263af7e68 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.164592 Jul 27 04:22:18.518027 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 53/93] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:18 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:18.975649 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0601e16d-3cc2-49f3-a167-2af7a3259273 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:18.976252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0601e16d-3cc2-49f3-a167-2af7a3259273 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:18.983211 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0601e16d-3cc2-49f3-a167-2af7a3259273 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:18.983649 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0601e16d-3cc2-49f3-a167-2af7a3259273 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:18.984405 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0601e16d-3cc2-49f3-a167-2af7a3259273 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:18.985031 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0601e16d-3cc2-49f3-a167-2af7a3259273 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:19.148552 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-0601e16d-3cc2-49f3-a167-2af7a3259273 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:19.159320 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0601e16d-3cc2-49f3-a167-2af7a3259273 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.185382 Jul 27 04:22:19.161503 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 41/94] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:18 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:19.539852 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-486ea56b-df7d-423b-912d-d1a2130d726c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:19.541992 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-486ea56b-df7d-423b-912d-d1a2130d726c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:19.550813 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-486ea56b-df7d-423b-912d-d1a2130d726c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:19.551267 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-486ea56b-df7d-423b-912d-d1a2130d726c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:19.552146 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-486ea56b-df7d-423b-912d-d1a2130d726c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:19.552648 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-486ea56b-df7d-423b-912d-d1a2130d726c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:19.904474 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-486ea56b-df7d-423b-912d-d1a2130d726c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:19.915771 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-486ea56b-df7d-423b-912d-d1a2130d726c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.380423 Jul 27 04:22:19.916497 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 54/95] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:19 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:20.183315 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4741a358-c389-41e8-b255-cd75b610f7df tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:20.183964 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4741a358-c389-41e8-b255-cd75b610f7df tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:20.189822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4741a358-c389-41e8-b255-cd75b610f7df tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:20.190286 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4741a358-c389-41e8-b255-cd75b610f7df tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:20.191205 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4741a358-c389-41e8-b255-cd75b610f7df tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:20.191633 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4741a358-c389-41e8-b255-cd75b610f7df tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:20.352324 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4741a358-c389-41e8-b255-cd75b610f7df tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:20.363255 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4741a358-c389-41e8-b255-cd75b610f7df tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.183541 Jul 27 04:22:20.379587 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 42/96] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:20 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:20.939474 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-55b3dacd-4eef-41a4-b4cb-02c3e2813852 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:20.940800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-55b3dacd-4eef-41a4-b4cb-02c3e2813852 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:20.947450 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-55b3dacd-4eef-41a4-b4cb-02c3e2813852 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:20.948271 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-55b3dacd-4eef-41a4-b4cb-02c3e2813852 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:20.949347 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-55b3dacd-4eef-41a4-b4cb-02c3e2813852 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:20.950029 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-55b3dacd-4eef-41a4-b4cb-02c3e2813852 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:21.137961 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-55b3dacd-4eef-41a4-b4cb-02c3e2813852 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:21.149279 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-55b3dacd-4eef-41a4-b4cb-02c3e2813852 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.214953 Jul 27 04:22:21.150906 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 55/97] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:20 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:22:21.388877 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-029e2af2-8c73-4d3f-a5ce-511388b1b57d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:21.389683 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-029e2af2-8c73-4d3f-a5ce-511388b1b57d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:21.400091 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-029e2af2-8c73-4d3f-a5ce-511388b1b57d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:21.400652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-029e2af2-8c73-4d3f-a5ce-511388b1b57d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:21.401455 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-029e2af2-8c73-4d3f-a5ce-511388b1b57d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:21.404138 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-029e2af2-8c73-4d3f-a5ce-511388b1b57d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:21.589029 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-029e2af2-8c73-4d3f-a5ce-511388b1b57d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:21.609449 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-029e2af2-8c73-4d3f-a5ce-511388b1b57d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.225630 Jul 27 04:22:21.616116 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 43/98] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:21 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:22.176288 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d72f64c2-46fa-489f-8221-6f8f84840d54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:22.177053 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d72f64c2-46fa-489f-8221-6f8f84840d54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:22.183813 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d72f64c2-46fa-489f-8221-6f8f84840d54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:22.184262 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d72f64c2-46fa-489f-8221-6f8f84840d54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:22.185035 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d72f64c2-46fa-489f-8221-6f8f84840d54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:22.185469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d72f64c2-46fa-489f-8221-6f8f84840d54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:22.327681 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d72f64c2-46fa-489f-8221-6f8f84840d54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:22.335490 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d72f64c2-46fa-489f-8221-6f8f84840d54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.163125 Jul 27 04:22:22.336352 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 56/99] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:22 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:22.638021 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-12cd8f14-cebc-4308-930d-49b088f7d152 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:22.638587 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-12cd8f14-cebc-4308-930d-49b088f7d152 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:22.644550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-12cd8f14-cebc-4308-930d-49b088f7d152 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:22.645084 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-12cd8f14-cebc-4308-930d-49b088f7d152 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:22.646041 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-12cd8f14-cebc-4308-930d-49b088f7d152 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:22.646484 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-12cd8f14-cebc-4308-930d-49b088f7d152 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:22.793127 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-12cd8f14-cebc-4308-930d-49b088f7d152 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:22.801952 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-12cd8f14-cebc-4308-930d-49b088f7d152 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.168431 Jul 27 04:22:22.802552 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 44/100] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:22 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:22:23.356385 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-213711c2-3836-4a39-be78-69ef8e89c81e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:23.357087 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-213711c2-3836-4a39-be78-69ef8e89c81e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:23.363104 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-213711c2-3836-4a39-be78-69ef8e89c81e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:23.363550 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-213711c2-3836-4a39-be78-69ef8e89c81e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:23.364493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-213711c2-3836-4a39-be78-69ef8e89c81e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:23.364933 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-213711c2-3836-4a39-be78-69ef8e89c81e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:23.516700 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-213711c2-3836-4a39-be78-69ef8e89c81e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:23.524208 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-213711c2-3836-4a39-be78-69ef8e89c81e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.171706 Jul 27 04:22:23.524794 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 57/101] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:23 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:23.823257 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ea345df7-8b50-42aa-bb2b-a26c3a9ade24 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:23.823863 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ea345df7-8b50-42aa-bb2b-a26c3a9ade24 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:23.830351 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ea345df7-8b50-42aa-bb2b-a26c3a9ade24 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:23.830788 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ea345df7-8b50-42aa-bb2b-a26c3a9ade24 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:23.831541 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ea345df7-8b50-42aa-bb2b-a26c3a9ade24 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:23.831968 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ea345df7-8b50-42aa-bb2b-a26c3a9ade24 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:23.963811 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ea345df7-8b50-42aa-bb2b-a26c3a9ade24 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:23.971316 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ea345df7-8b50-42aa-bb2b-a26c3a9ade24 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.152192 Jul 27 04:22:23.971879 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 45/102] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:23 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:24.546630 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-80dd4073-3186-48d1-96aa-79f3b65e86e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:24.547248 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-80dd4073-3186-48d1-96aa-79f3b65e86e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:24.552598 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:24.558968 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-80dd4073-3186-48d1-96aa-79f3b65e86e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:24.559460 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-80dd4073-3186-48d1-96aa-79f3b65e86e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:24.560910 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-80dd4073-3186-48d1-96aa-79f3b65e86e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:24.562196 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-80dd4073-3186-48d1-96aa-79f3b65e86e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:24.707994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-80dd4073-3186-48d1-96aa-79f3b65e86e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:24.717376 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-80dd4073-3186-48d1-96aa-79f3b65e86e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.175514 Jul 27 04:22:24.717965 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 58/103] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:24 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:24.992039 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-42b56c15-67fe-476b-a8bd-74982b3cc50d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:24.993318 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-42b56c15-67fe-476b-a8bd-74982b3cc50d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:25.000071 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-42b56c15-67fe-476b-a8bd-74982b3cc50d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:25.000521 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-42b56c15-67fe-476b-a8bd-74982b3cc50d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:25.001789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-42b56c15-67fe-476b-a8bd-74982b3cc50d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:25.002471 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-42b56c15-67fe-476b-a8bd-74982b3cc50d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:25.190971 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-42b56c15-67fe-476b-a8bd-74982b3cc50d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:25.202922 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-42b56c15-67fe-476b-a8bd-74982b3cc50d tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.215001 Jul 27 04:22:25.203728 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 46/104] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:24 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:25.738584 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-045189fd-c662-4ac4-853d-3507a26e4461 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:25.739432 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-045189fd-c662-4ac4-853d-3507a26e4461 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:25.745734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-045189fd-c662-4ac4-853d-3507a26e4461 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:25.746230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-045189fd-c662-4ac4-853d-3507a26e4461 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:25.747001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-045189fd-c662-4ac4-853d-3507a26e4461 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:25.747618 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-045189fd-c662-4ac4-853d-3507a26e4461 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:25.890763 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-045189fd-c662-4ac4-853d-3507a26e4461 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:25.899183 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-045189fd-c662-4ac4-853d-3507a26e4461 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.164326 Jul 27 04:22:25.910295 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 59/105] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:25 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:26.228255 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6e1a5e50-59f2-4f88-b0ca-322f0a8348d4 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:26.229833 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6e1a5e50-59f2-4f88-b0ca-322f0a8348d4 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:26.236180 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6e1a5e50-59f2-4f88-b0ca-322f0a8348d4 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:26.236750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6e1a5e50-59f2-4f88-b0ca-322f0a8348d4 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:26.237622 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6e1a5e50-59f2-4f88-b0ca-322f0a8348d4 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:26.238202 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6e1a5e50-59f2-4f88-b0ca-322f0a8348d4 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:26.422454 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6e1a5e50-59f2-4f88-b0ca-322f0a8348d4 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:26.431364 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6e1a5e50-59f2-4f88-b0ca-322f0a8348d4 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.206684 Jul 27 04:22:26.432444 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 47/106] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:26 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:26.921078 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-67749b96-39ba-456c-bdb6-bed62143973e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:26.921733 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-67749b96-39ba-456c-bdb6-bed62143973e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:26.927946 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-67749b96-39ba-456c-bdb6-bed62143973e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:26.928384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-67749b96-39ba-456c-bdb6-bed62143973e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:26.929338 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-67749b96-39ba-456c-bdb6-bed62143973e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:26.929961 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-67749b96-39ba-456c-bdb6-bed62143973e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:27.169716 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-67749b96-39ba-456c-bdb6-bed62143973e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:27.178342 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-67749b96-39ba-456c-bdb6-bed62143973e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.261283 Jul 27 04:22:27.179023 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 60/107] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:26 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:27.456571 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2560b115-b87e-49f8-9461-e0b52c93adf5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:27.457479 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2560b115-b87e-49f8-9461-e0b52c93adf5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:27.466322 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2560b115-b87e-49f8-9461-e0b52c93adf5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:27.467083 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2560b115-b87e-49f8-9461-e0b52c93adf5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:27.468162 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2560b115-b87e-49f8-9461-e0b52c93adf5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:27.469358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2560b115-b87e-49f8-9461-e0b52c93adf5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:27.640398 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2560b115-b87e-49f8-9461-e0b52c93adf5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:27.649442 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2560b115-b87e-49f8-9461-e0b52c93adf5 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.198210 Jul 27 04:22:27.650919 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 48/108] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:27 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:28.199789 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-92f63885-b60c-4e73-9f3b-26378dde1b62 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:28.201031 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-92f63885-b60c-4e73-9f3b-26378dde1b62 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:28.207500 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-92f63885-b60c-4e73-9f3b-26378dde1b62 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:28.207941 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-92f63885-b60c-4e73-9f3b-26378dde1b62 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:28.208903 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-92f63885-b60c-4e73-9f3b-26378dde1b62 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:28.209646 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-92f63885-b60c-4e73-9f3b-26378dde1b62 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:28.380435 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-92f63885-b60c-4e73-9f3b-26378dde1b62 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:28.392010 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-92f63885-b60c-4e73-9f3b-26378dde1b62 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.195830 Jul 27 04:22:28.392600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 61/109] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:28 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:28.674255 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f98383d3-21ab-40c5-aa45-64164bf2a831 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:28.674870 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f98383d3-21ab-40c5-aa45-64164bf2a831 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:28.681514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f98383d3-21ab-40c5-aa45-64164bf2a831 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:28.682035 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f98383d3-21ab-40c5-aa45-64164bf2a831 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:28.682838 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f98383d3-21ab-40c5-aa45-64164bf2a831 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:28.683418 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f98383d3-21ab-40c5-aa45-64164bf2a831 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:28.852217 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f98383d3-21ab-40c5-aa45-64164bf2a831 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:28.867097 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f98383d3-21ab-40c5-aa45-64164bf2a831 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.196753 Jul 27 04:22:28.867944 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 49/110] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:28 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:29.416674 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ed3db3f5-ad42-418f-801f-534a1fcffa21 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:29.417481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ed3db3f5-ad42-418f-801f-534a1fcffa21 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:29.430428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ed3db3f5-ad42-418f-801f-534a1fcffa21 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:29.431413 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ed3db3f5-ad42-418f-801f-534a1fcffa21 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:29.432443 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ed3db3f5-ad42-418f-801f-534a1fcffa21 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:29.433464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ed3db3f5-ad42-418f-801f-534a1fcffa21 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:29.624410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ed3db3f5-ad42-418f-801f-534a1fcffa21 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:29.635584 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ed3db3f5-ad42-418f-801f-534a1fcffa21 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.223824 Jul 27 04:22:29.637391 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 62/111] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:29 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:29.894242 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b08b736a-ada7-485e-ae07-8523903ab184 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:29.895062 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-b08b736a-ada7-485e-ae07-8523903ab184 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:29.904373 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b08b736a-ada7-485e-ae07-8523903ab184 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:29.905344 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b08b736a-ada7-485e-ae07-8523903ab184 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:29.909471 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b08b736a-ada7-485e-ae07-8523903ab184 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:29.910274 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b08b736a-ada7-485e-ae07-8523903ab184 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:30.081458 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-b08b736a-ada7-485e-ae07-8523903ab184 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:30.091372 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-b08b736a-ada7-485e-ae07-8523903ab184 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.206571 Jul 27 04:22:30.091950 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 50/112] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:29 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:30.659830 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0c482347-c0a1-4709-b5ba-995eec746f8d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:30.661365 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0c482347-c0a1-4709-b5ba-995eec746f8d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:30.668953 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0c482347-c0a1-4709-b5ba-995eec746f8d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:30.669838 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0c482347-c0a1-4709-b5ba-995eec746f8d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:30.671505 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0c482347-c0a1-4709-b5ba-995eec746f8d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:30.672186 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0c482347-c0a1-4709-b5ba-995eec746f8d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:30.915134 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0c482347-c0a1-4709-b5ba-995eec746f8d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:30.928518 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0c482347-c0a1-4709-b5ba-995eec746f8d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.272740 Jul 27 04:22:30.929649 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 63/113] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:30 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:31.113761 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-2fdb373f-b6a9-4d2b-abf4-9e8e9895929f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:31.114643 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-2fdb373f-b6a9-4d2b-abf4-9e8e9895929f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:31.138272 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2fdb373f-b6a9-4d2b-abf4-9e8e9895929f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:31.138272 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2fdb373f-b6a9-4d2b-abf4-9e8e9895929f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:31.138272 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2fdb373f-b6a9-4d2b-abf4-9e8e9895929f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:31.138272 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2fdb373f-b6a9-4d2b-abf4-9e8e9895929f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:31.423129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-66daa167-41f8-4e7d-983c-f0b90c874c42 req-a06cb9db-d2ff-477f-8f8f-a7123dccd020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9878f853-653a-4dbc-beb5-e1191e7c3e5f", "name": "network-vif-plugged", "status": "completed", "tag": "32e0b1d6-6e4d-40a3-8ab0-ac75771d2bfc"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:22:31.445067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-66daa167-41f8-4e7d-983c-f0b90c874c42 req-a06cb9db-d2ff-477f-8f8f-a7123dccd020 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:31.447444 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-66daa167-41f8-4e7d-983c-f0b90c874c42 req-a06cb9db-d2ff-477f-8f8f-a7123dccd020 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:31.476125 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-66daa167-41f8-4e7d-983c-f0b90c874c42 req-a06cb9db-d2ff-477f-8f8f-a7123dccd020 service nova] Creating event network-vif-plugged:32e0b1d6-6e4d-40a3-8ab0-ac75771d2bfc for instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f on hv-cinder-85098 Jul 27 04:22:31.484010 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-2fdb373f-b6a9-4d2b-abf4-9e8e9895929f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:31.508352 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-2fdb373f-b6a9-4d2b-abf4-9e8e9895929f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.398589 Jul 27 04:22:31.522345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 64/114] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:31 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:31.526612 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-66daa167-41f8-4e7d-983c-f0b90c874c42 req-a06cb9db-d2ff-477f-8f8f-a7123dccd020 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.615880 Jul 27 04:22:31.528778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 51/115] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:22:31.960032 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-6e4a6302-0509-4192-a9cf-a0a04fcdb834 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:31.960781 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-6e4a6302-0509-4192-a9cf-a0a04fcdb834 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:31.976494 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6e4a6302-0509-4192-a9cf-a0a04fcdb834 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:31.977049 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6e4a6302-0509-4192-a9cf-a0a04fcdb834 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:31.978621 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6e4a6302-0509-4192-a9cf-a0a04fcdb834 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:31.979609 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6e4a6302-0509-4192-a9cf-a0a04fcdb834 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:32.025378 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=100 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:32.298360 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-6e4a6302-0509-4192-a9cf-a0a04fcdb834 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:32.323280 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-6e4a6302-0509-4192-a9cf-a0a04fcdb834 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.371619 Jul 27 04:22:32.340398 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 65/116] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:31 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:32.530547 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9631352b-c939-4f6a-bae9-a851fb5a4fbe tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:32.531536 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9631352b-c939-4f6a-bae9-a851fb5a4fbe tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:32.559395 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9631352b-c939-4f6a-bae9-a851fb5a4fbe tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:32.570046 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9631352b-c939-4f6a-bae9-a851fb5a4fbe tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:32.570046 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9631352b-c939-4f6a-bae9-a851fb5a4fbe tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:32.570046 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9631352b-c939-4f6a-bae9-a851fb5a4fbe tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:32.899063 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9631352b-c939-4f6a-bae9-a851fb5a4fbe tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:32.909415 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9631352b-c939-4f6a-bae9-a851fb5a4fbe tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.383397 Jul 27 04:22:32.910142 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 52/117] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:32 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:33.346857 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-70584f01-f22f-42fb-9b0a-a5baa7d6335a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:33.348626 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-70584f01-f22f-42fb-9b0a-a5baa7d6335a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:33.355850 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-70584f01-f22f-42fb-9b0a-a5baa7d6335a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:33.356298 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-70584f01-f22f-42fb-9b0a-a5baa7d6335a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:33.357066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-70584f01-f22f-42fb-9b0a-a5baa7d6335a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:33.357500 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-70584f01-f22f-42fb-9b0a-a5baa7d6335a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:33.574004 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-70584f01-f22f-42fb-9b0a-a5baa7d6335a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:33.583340 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-70584f01-f22f-42fb-9b0a-a5baa7d6335a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.242178 Jul 27 04:22:33.584666 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 66/118] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:33 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:33.619581 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-fe2c5f81-3f91-4d41-b0f3-faa5e8c79f8a req-d39bbd15-6612-4991-8f70-9ed174afe2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259425f9-0ddb-4181-8639-9b3446d21d80", "name": "network-vif-plugged", "status": "completed", "tag": "7e7ba03c-2d08-4012-8a46-6bae711cc6e3"}, {"server_uuid": "b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c", "name": "network-vif-plugged", "status": "completed", "tag": "a40f4c5b-77ca-4a0a-a4d4-f5f9a5b1014f"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:22:33.634976 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-fe2c5f81-3f91-4d41-b0f3-faa5e8c79f8a req-d39bbd15-6612-4991-8f70-9ed174afe2c5 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:33.635492 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-fe2c5f81-3f91-4d41-b0f3-faa5e8c79f8a req-d39bbd15-6612-4991-8f70-9ed174afe2c5 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:33.655579 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-fe2c5f81-3f91-4d41-b0f3-faa5e8c79f8a req-d39bbd15-6612-4991-8f70-9ed174afe2c5 service nova] Creating event network-vif-plugged:7e7ba03c-2d08-4012-8a46-6bae711cc6e3 for instance 259425f9-0ddb-4181-8639-9b3446d21d80 on hv-cinder-85098 Jul 27 04:22:33.656127 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-fe2c5f81-3f91-4d41-b0f3-faa5e8c79f8a req-d39bbd15-6612-4991-8f70-9ed174afe2c5 service nova] Creating event network-vif-plugged:a40f4c5b-77ca-4a0a-a4d4-f5f9a5b1014f for instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c on hv-cinder-85098 Jul 27 04:22:33.674694 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-fe2c5f81-3f91-4d41-b0f3-faa5e8c79f8a req-d39bbd15-6612-4991-8f70-9ed174afe2c5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048994 Jul 27 04:22:33.681642 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 53/119] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:22:33.934461 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c427178e-9153-48d0-8de5-af3f9d50e7fd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:33.935537 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c427178e-9153-48d0-8de5-af3f9d50e7fd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:33.949527 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c427178e-9153-48d0-8de5-af3f9d50e7fd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:33.950237 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c427178e-9153-48d0-8de5-af3f9d50e7fd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:33.952995 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c427178e-9153-48d0-8de5-af3f9d50e7fd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:33.953446 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c427178e-9153-48d0-8de5-af3f9d50e7fd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:34.147354 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-c427178e-9153-48d0-8de5-af3f9d50e7fd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:34.160929 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c427178e-9153-48d0-8de5-af3f9d50e7fd tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.230775 Jul 27 04:22:34.161847 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 67/120] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:33 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:34.605144 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-bdb80618-9275-4c6e-a177-61bc158238ad tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:34.605846 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-bdb80618-9275-4c6e-a177-61bc158238ad tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:34.615035 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bdb80618-9275-4c6e-a177-61bc158238ad tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:34.615484 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bdb80618-9275-4c6e-a177-61bc158238ad tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:34.616256 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bdb80618-9275-4c6e-a177-61bc158238ad tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:34.616692 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bdb80618-9275-4c6e-a177-61bc158238ad tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:34.786053 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-bdb80618-9275-4c6e-a177-61bc158238ad tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:34.795432 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-bdb80618-9275-4c6e-a177-61bc158238ad tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.194467 Jul 27 04:22:34.796018 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 54/121] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:34 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:35.210823 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-cddc7c60-ad32-496b-9c8b-2ef47517e6ca tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:35.212947 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-cddc7c60-ad32-496b-9c8b-2ef47517e6ca tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:35.220853 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cddc7c60-ad32-496b-9c8b-2ef47517e6ca tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:35.221611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cddc7c60-ad32-496b-9c8b-2ef47517e6ca tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:35.222431 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cddc7c60-ad32-496b-9c8b-2ef47517e6ca tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:35.222872 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cddc7c60-ad32-496b-9c8b-2ef47517e6ca tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:35.396134 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-cddc7c60-ad32-496b-9c8b-2ef47517e6ca tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:35.405220 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-cddc7c60-ad32-496b-9c8b-2ef47517e6ca tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.200719 Jul 27 04:22:35.405798 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 68/122] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:35 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:35.825372 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-fa557e37-b806-45d8-b888-fb6778481e81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:35.826349 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-fa557e37-b806-45d8-b888-fb6778481e81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:35.842640 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fa557e37-b806-45d8-b888-fb6778481e81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:35.846448 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fa557e37-b806-45d8-b888-fb6778481e81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:35.849216 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fa557e37-b806-45d8-b888-fb6778481e81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:35.851845 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fa557e37-b806-45d8-b888-fb6778481e81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:36.191462 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-fa557e37-b806-45d8-b888-fb6778481e81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:36.195380 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=100 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:36.200779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-fa557e37-b806-45d8-b888-fb6778481e81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.385993 Jul 27 04:22:36.201374 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 55/123] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:35 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:36.429368 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ad0086eb-c75b-4d9e-8898-e91f5bc2625f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:36.432338 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ad0086eb-c75b-4d9e-8898-e91f5bc2625f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:36.443748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ad0086eb-c75b-4d9e-8898-e91f5bc2625f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:36.444903 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ad0086eb-c75b-4d9e-8898-e91f5bc2625f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:36.445869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ad0086eb-c75b-4d9e-8898-e91f5bc2625f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:36.447503 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ad0086eb-c75b-4d9e-8898-e91f5bc2625f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:36.658244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ad0086eb-c75b-4d9e-8898-e91f5bc2625f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:36.667933 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ad0086eb-c75b-4d9e-8898-e91f5bc2625f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.244667 Jul 27 04:22:36.669505 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 69/124] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:36 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:37.225057 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-54947122-8ce3-458a-b5db-d3c961c94187 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:37.225550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-54947122-8ce3-458a-b5db-d3c961c94187 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:37.233764 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-54947122-8ce3-458a-b5db-d3c961c94187 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:37.238834 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-54947122-8ce3-458a-b5db-d3c961c94187 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:37.240387 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-54947122-8ce3-458a-b5db-d3c961c94187 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:37.241635 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-54947122-8ce3-458a-b5db-d3c961c94187 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:37.398695 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-54947122-8ce3-458a-b5db-d3c961c94187 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:37.407431 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-54947122-8ce3-458a-b5db-d3c961c94187 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.186626 Jul 27 04:22:37.408203 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 56/125] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:37 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:37.690839 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b449b83d-63eb-4371-93c8-41232d8ef75c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:37.691451 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b449b83d-63eb-4371-93c8-41232d8ef75c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:37.698670 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b449b83d-63eb-4371-93c8-41232d8ef75c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:37.699116 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b449b83d-63eb-4371-93c8-41232d8ef75c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:37.699872 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b449b83d-63eb-4371-93c8-41232d8ef75c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:37.700299 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b449b83d-63eb-4371-93c8-41232d8ef75c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:37.855518 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b449b83d-63eb-4371-93c8-41232d8ef75c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:37.873987 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b449b83d-63eb-4371-93c8-41232d8ef75c tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.180390 Jul 27 04:22:37.880091 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 70/126] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:37 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:38.430703 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3a547922-f4ec-43d9-895b-3400b3b2bb86 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:38.431524 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-3a547922-f4ec-43d9-895b-3400b3b2bb86 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:38.437524 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3a547922-f4ec-43d9-895b-3400b3b2bb86 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:38.438084 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3a547922-f4ec-43d9-895b-3400b3b2bb86 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:38.438943 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3a547922-f4ec-43d9-895b-3400b3b2bb86 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:38.439368 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3a547922-f4ec-43d9-895b-3400b3b2bb86 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:38.581867 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-3a547922-f4ec-43d9-895b-3400b3b2bb86 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:38.589765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-3a547922-f4ec-43d9-895b-3400b3b2bb86 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.162864 Jul 27 04:22:38.590369 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 57/127] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:38 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:38.891673 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-bfdb8960-f45f-4844-8eb2-f63294d14846 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:38.892573 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-bfdb8960-f45f-4844-8eb2-f63294d14846 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:38.899163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bfdb8960-f45f-4844-8eb2-f63294d14846 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:38.900116 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bfdb8960-f45f-4844-8eb2-f63294d14846 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:38.901195 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bfdb8960-f45f-4844-8eb2-f63294d14846 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:38.901847 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bfdb8960-f45f-4844-8eb2-f63294d14846 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:39.133058 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-bfdb8960-f45f-4844-8eb2-f63294d14846 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:39.140706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-bfdb8960-f45f-4844-8eb2-f63294d14846 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1315 microversion: 2.1 time: 0.253192 Jul 27 04:22:39.141278 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 71/128] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:38 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:39.610796 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3ff90cf2-ee5b-4f13-999d-74b3129bd4d4 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:39.611309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-3ff90cf2-ee5b-4f13-999d-74b3129bd4d4 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:39.617236 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3ff90cf2-ee5b-4f13-999d-74b3129bd4d4 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:39.617682 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3ff90cf2-ee5b-4f13-999d-74b3129bd4d4 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:39.619514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3ff90cf2-ee5b-4f13-999d-74b3129bd4d4 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:39.619805 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3ff90cf2-ee5b-4f13-999d-74b3129bd4d4 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:39.764115 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-3ff90cf2-ee5b-4f13-999d-74b3129bd4d4 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:39.772170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-3ff90cf2-ee5b-4f13-999d-74b3129bd4d4 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1322 microversion: 2.1 time: 0.165333 Jul 27 04:22:39.772959 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 58/129] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:39 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:40.164597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-14b1b0e9-8780-45cd-8df4-07b22020a299 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:40.165872 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-14b1b0e9-8780-45cd-8df4-07b22020a299 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:40.172833 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-14b1b0e9-8780-45cd-8df4-07b22020a299 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:40.173358 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-14b1b0e9-8780-45cd-8df4-07b22020a299 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:40.174226 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-14b1b0e9-8780-45cd-8df4-07b22020a299 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:40.174667 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-14b1b0e9-8780-45cd-8df4-07b22020a299 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:40.335121 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-14b1b0e9-8780-45cd-8df4-07b22020a299 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:40.346531 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-14b1b0e9-8780-45cd-8df4-07b22020a299 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1502 microversion: 2.1 time: 0.185847 Jul 27 04:22:40.347453 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 72/130] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:40 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:40.793221 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8f25ad08-bdd1-429a-8608-10caa9aeddd2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:40.793905 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8f25ad08-bdd1-429a-8608-10caa9aeddd2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:40.800117 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8f25ad08-bdd1-429a-8608-10caa9aeddd2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:40.800557 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8f25ad08-bdd1-429a-8608-10caa9aeddd2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:40.801406 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8f25ad08-bdd1-429a-8608-10caa9aeddd2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:40.801831 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8f25ad08-bdd1-429a-8608-10caa9aeddd2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:40.946652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8f25ad08-bdd1-429a-8608-10caa9aeddd2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:40.954355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8f25ad08-bdd1-429a-8608-10caa9aeddd2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1515 microversion: 2.1 time: 0.165518 Jul 27 04:22:40.955347 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 59/131] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:40 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:40.978152 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c65afb54-5978-4aa0-baba-3a5d028cc077 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:22:40.980335 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c65afb54-5978-4aa0-baba-3a5d028cc077 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:40.986812 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c65afb54-5978-4aa0-baba-3a5d028cc077 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:40.987259 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c65afb54-5978-4aa0-baba-3a5d028cc077 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:40.988221 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c65afb54-5978-4aa0-baba-3a5d028cc077 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:40.988655 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c65afb54-5978-4aa0-baba-3a5d028cc077 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:41.059797 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-c65afb54-5978-4aa0-baba-3a5d028cc077 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lazy-loading 'flavor' on Instance uuid 259425f9-0ddb-4181-8639-9b3446d21d80 {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:22:41.178443 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c65afb54-5978-4aa0-baba-3a5d028cc077 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "POST /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80/action" status: 200 len: 32 microversion: 2.1 time: 0.205963 Jul 27 04:22:41.179101 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 73/132] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:22:40 2022] POST /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 04:22:41.188555 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0ad8b85d-467e-49c5-b781-2e8be3ce5525 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:41.189164 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0ad8b85d-467e-49c5-b781-2e8be3ce5525 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:41.195624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0ad8b85d-467e-49c5-b781-2e8be3ce5525 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:41.196071 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0ad8b85d-467e-49c5-b781-2e8be3ce5525 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:41.197330 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0ad8b85d-467e-49c5-b781-2e8be3ce5525 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:41.197783 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0ad8b85d-467e-49c5-b781-2e8be3ce5525 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:41.322892 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-0ad8b85d-467e-49c5-b781-2e8be3ce5525 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:41.330960 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0ad8b85d-467e-49c5-b781-2e8be3ce5525 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.146231 Jul 27 04:22:41.331530 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 60/133] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:41 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:42.352208 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-cff30130-89a2-4c68-b57e-0f69e93f6741 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:42.353543 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-cff30130-89a2-4c68-b57e-0f69e93f6741 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:42.359716 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cff30130-89a2-4c68-b57e-0f69e93f6741 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:42.360166 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cff30130-89a2-4c68-b57e-0f69e93f6741 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:42.360932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cff30130-89a2-4c68-b57e-0f69e93f6741 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:42.361369 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cff30130-89a2-4c68-b57e-0f69e93f6741 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:42.489345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-cff30130-89a2-4c68-b57e-0f69e93f6741 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:42.496822 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-cff30130-89a2-4c68-b57e-0f69e93f6741 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.149011 Jul 27 04:22:42.497382 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 74/134] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:42 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:43.518755 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c457c3d9-9061-4656-8f83-783af186c477 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:43.519359 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c457c3d9-9061-4656-8f83-783af186c477 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:43.525965 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c457c3d9-9061-4656-8f83-783af186c477 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:43.526428 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c457c3d9-9061-4656-8f83-783af186c477 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:43.527179 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c457c3d9-9061-4656-8f83-783af186c477 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:43.527604 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c457c3d9-9061-4656-8f83-783af186c477 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:43.682878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c457c3d9-9061-4656-8f83-783af186c477 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:43.691828 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c457c3d9-9061-4656-8f83-783af186c477 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.176694 Jul 27 04:22:43.692770 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 61/135] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:43 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:43.939863 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-60e76f7f-1c7a-4d10-b47e-f4893a95a231 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b25256f-1b14-4e79-b2fe-899575563971"}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:22:43.943853 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-60e76f7f-1c7a-4d10-b47e-f4893a95a231 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:43.951938 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-60e76f7f-1c7a-4d10-b47e-f4893a95a231 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:43.952460 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-60e76f7f-1c7a-4d10-b47e-f4893a95a231 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:43.953268 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-60e76f7f-1c7a-4d10-b47e-f4893a95a231 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:43.953855 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-60e76f7f-1c7a-4d10-b47e-f4893a95a231 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:44.714782 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8cf4ed0d-65b0-4fb2-9bc9-66cc23d8aacb tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:44.715553 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8cf4ed0d-65b0-4fb2-9bc9-66cc23d8aacb tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:44.722775 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8cf4ed0d-65b0-4fb2-9bc9-66cc23d8aacb tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:44.723338 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8cf4ed0d-65b0-4fb2-9bc9-66cc23d8aacb tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:44.724273 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8cf4ed0d-65b0-4fb2-9bc9-66cc23d8aacb tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:44.724821 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8cf4ed0d-65b0-4fb2-9bc9-66cc23d8aacb tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:44.916367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8cf4ed0d-65b0-4fb2-9bc9-66cc23d8aacb tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:44.928383 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8cf4ed0d-65b0-4fb2-9bc9-66cc23d8aacb tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.218874 Jul 27 04:22:44.929429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 62/136] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:44 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:45.250993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-60e76f7f-1c7a-4d10-b47e-f4893a95a231 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "POST /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.321138 Jul 27 04:22:45.252343 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 75/137] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:22:43 2022] POST /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f/os-volume_attachments => generated 194 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:22:45.953082 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f55b8ce0-65e5-4951-a556-f56c56d880d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:45.954238 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f55b8ce0-65e5-4951-a556-f56c56d880d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:45.964399 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f55b8ce0-65e5-4951-a556-f56c56d880d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:45.967716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f55b8ce0-65e5-4951-a556-f56c56d880d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:45.968764 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f55b8ce0-65e5-4951-a556-f56c56d880d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:45.969205 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f55b8ce0-65e5-4951-a556-f56c56d880d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:46.327722 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f55b8ce0-65e5-4951-a556-f56c56d880d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:46.347827 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f55b8ce0-65e5-4951-a556-f56c56d880d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.396652 Jul 27 04:22:46.348704 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 63/138] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:45 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:47.371509 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e5d1301d-e21a-4528-bd55-478ebb7c6f5a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:47.372812 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e5d1301d-e21a-4528-bd55-478ebb7c6f5a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:47.376653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=48 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:47.393422 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e5d1301d-e21a-4528-bd55-478ebb7c6f5a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:47.394559 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e5d1301d-e21a-4528-bd55-478ebb7c6f5a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:47.396758 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e5d1301d-e21a-4528-bd55-478ebb7c6f5a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:47.399742 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e5d1301d-e21a-4528-bd55-478ebb7c6f5a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:47.753464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e5d1301d-e21a-4528-bd55-478ebb7c6f5a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:47.774615 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e5d1301d-e21a-4528-bd55-478ebb7c6f5a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.408699 Jul 27 04:22:47.775218 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 76/139] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:47 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:48.802149 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-15c13c39-4546-437a-b5cc-9b44d6c1deec tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:48.803116 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-15c13c39-4546-437a-b5cc-9b44d6c1deec tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:48.810206 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=48 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:48.811976 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-15c13c39-4546-437a-b5cc-9b44d6c1deec tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:48.812715 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-15c13c39-4546-437a-b5cc-9b44d6c1deec tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:48.814388 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-15c13c39-4546-437a-b5cc-9b44d6c1deec tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:48.814903 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-15c13c39-4546-437a-b5cc-9b44d6c1deec tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:48.987904 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-15c13c39-4546-437a-b5cc-9b44d6c1deec tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:48.998030 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-15c13c39-4546-437a-b5cc-9b44d6c1deec tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.200075 Jul 27 04:22:48.999157 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 64/140] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:48 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:50.020920 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-20cbdf2c-c5a2-4311-b471-1b780dbea68e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:50.021534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-20cbdf2c-c5a2-4311-b471-1b780dbea68e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:50.040572 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-20cbdf2c-c5a2-4311-b471-1b780dbea68e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:50.041405 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-20cbdf2c-c5a2-4311-b471-1b780dbea68e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:50.043408 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-20cbdf2c-c5a2-4311-b471-1b780dbea68e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:50.044115 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-20cbdf2c-c5a2-4311-b471-1b780dbea68e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:50.244313 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-20cbdf2c-c5a2-4311-b471-1b780dbea68e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:50.249767 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-20cbdf2c-c5a2-4311-b471-1b780dbea68e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.231066 Jul 27 04:22:50.250708 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 77/141] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:50 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:51.272237 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-82d368dd-9477-477b-9658-3aee4b872522 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:51.273227 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-82d368dd-9477-477b-9658-3aee4b872522 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:51.280930 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-82d368dd-9477-477b-9658-3aee4b872522 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:51.281380 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-82d368dd-9477-477b-9658-3aee4b872522 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:51.282196 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-82d368dd-9477-477b-9658-3aee4b872522 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:51.282632 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-82d368dd-9477-477b-9658-3aee4b872522 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:51.468542 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-82d368dd-9477-477b-9658-3aee4b872522 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:51.476474 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-82d368dd-9477-477b-9658-3aee4b872522 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.208507 Jul 27 04:22:51.477048 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 65/142] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:51 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:52.499663 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3a0ddbdb-a510-4368-99dc-6aa44e18eb5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:52.499663 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3a0ddbdb-a510-4368-99dc-6aa44e18eb5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:52.506205 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3a0ddbdb-a510-4368-99dc-6aa44e18eb5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:52.506656 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3a0ddbdb-a510-4368-99dc-6aa44e18eb5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:52.507431 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3a0ddbdb-a510-4368-99dc-6aa44e18eb5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:52.508023 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3a0ddbdb-a510-4368-99dc-6aa44e18eb5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:52.527015 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:52.656716 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3a0ddbdb-a510-4368-99dc-6aa44e18eb5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:52.664289 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3a0ddbdb-a510-4368-99dc-6aa44e18eb5e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.169869 Jul 27 04:22:52.664860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 78/143] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:52 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:53.686331 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0e4a0b12-d77b-49ac-9f9f-2f5c70811103 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:53.687371 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0e4a0b12-d77b-49ac-9f9f-2f5c70811103 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:53.693258 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0e4a0b12-d77b-49ac-9f9f-2f5c70811103 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:53.693846 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0e4a0b12-d77b-49ac-9f9f-2f5c70811103 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:53.694936 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0e4a0b12-d77b-49ac-9f9f-2f5c70811103 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:53.695366 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0e4a0b12-d77b-49ac-9f9f-2f5c70811103 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:53.843511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-0e4a0b12-d77b-49ac-9f9f-2f5c70811103 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:53.852311 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0e4a0b12-d77b-49ac-9f9f-2f5c70811103 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.171358 Jul 27 04:22:53.853544 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 66/144] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:53 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:54.875616 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c9ea1dbf-5759-4be5-9028-e10b48002dde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:54.877394 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c9ea1dbf-5759-4be5-9028-e10b48002dde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:54.890767 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c9ea1dbf-5759-4be5-9028-e10b48002dde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:54.891219 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c9ea1dbf-5759-4be5-9028-e10b48002dde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:54.891845 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c9ea1dbf-5759-4be5-9028-e10b48002dde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:54.892278 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c9ea1dbf-5759-4be5-9028-e10b48002dde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:55.086063 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-c9ea1dbf-5759-4be5-9028-e10b48002dde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:55.095020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c9ea1dbf-5759-4be5-9028-e10b48002dde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.223914 Jul 27 04:22:55.095605 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 79/145] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:54 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:56.117141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-a79ce3b3-0b9d-474b-97a5-4b63a0d69bc0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:56.121885 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-a79ce3b3-0b9d-474b-97a5-4b63a0d69bc0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:56.134510 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a79ce3b3-0b9d-474b-97a5-4b63a0d69bc0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:56.135208 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a79ce3b3-0b9d-474b-97a5-4b63a0d69bc0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:56.146916 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a79ce3b3-0b9d-474b-97a5-4b63a0d69bc0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:56.147368 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a79ce3b3-0b9d-474b-97a5-4b63a0d69bc0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:56.309127 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-a79ce3b3-0b9d-474b-97a5-4b63a0d69bc0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:56.320512 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-a79ce3b3-0b9d-474b-97a5-4b63a0d69bc0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.207493 Jul 27 04:22:56.322008 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 67/146] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:56 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:56.615014 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3dd0ea3e-5be3-4ed4-94a6-7045b405822b tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:56.615578 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3dd0ea3e-5be3-4ed4-94a6-7045b405822b tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:56.622804 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3dd0ea3e-5be3-4ed4-94a6-7045b405822b tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:56.623256 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3dd0ea3e-5be3-4ed4-94a6-7045b405822b tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:56.624011 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3dd0ea3e-5be3-4ed4-94a6-7045b405822b tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:56.624477 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3dd0ea3e-5be3-4ed4-94a6-7045b405822b tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:56.649642 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3dd0ea3e-5be3-4ed4-94a6-7045b405822b tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Going to try to terminate instance {{(pid=117740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:22:56.739847 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3dd0ea3e-5be3-4ed4-94a6-7045b405822b tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 204 len: 0 microversion: 2.1 time: 0.128375 Jul 27 04:22:56.740635 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 80/147] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:22:56 2022] DELETE /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:22:56.749243 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-94f6d616-7d38-41c6-a618-46eaa1c006b3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:56.749889 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-94f6d616-7d38-41c6-a618-46eaa1c006b3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:56.756349 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-94f6d616-7d38-41c6-a618-46eaa1c006b3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:56.756800 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-94f6d616-7d38-41c6-a618-46eaa1c006b3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:56.758254 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-94f6d616-7d38-41c6-a618-46eaa1c006b3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:56.758705 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-94f6d616-7d38-41c6-a618-46eaa1c006b3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:56.899038 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-94f6d616-7d38-41c6-a618-46eaa1c006b3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:56.907812 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-94f6d616-7d38-41c6-a618-46eaa1c006b3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1554 microversion: 2.1 time: 0.162451 Jul 27 04:22:56.908455 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 68/148] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:56 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:22:57.344427 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-cde6c2b0-da8e-43e9-9769-6779865d6d75 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:57.345245 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-cde6c2b0-da8e-43e9-9769-6779865d6d75 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:57.351734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cde6c2b0-da8e-43e9-9769-6779865d6d75 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:57.352378 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cde6c2b0-da8e-43e9-9769-6779865d6d75 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:57.353496 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cde6c2b0-da8e-43e9-9769-6779865d6d75 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:57.355457 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cde6c2b0-da8e-43e9-9769-6779865d6d75 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:57.588554 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-cde6c2b0-da8e-43e9-9769-6779865d6d75 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:57.598660 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-cde6c2b0-da8e-43e9-9769-6779865d6d75 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.259643 Jul 27 04:22:57.599470 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 81/149] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:57 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:57.931407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-db6968e9-91f3-4b2a-b045-adf62b8774f3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:57.932009 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-db6968e9-91f3-4b2a-b045-adf62b8774f3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:57.941184 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-db6968e9-91f3-4b2a-b045-adf62b8774f3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:57.941715 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-db6968e9-91f3-4b2a-b045-adf62b8774f3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:57.942642 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-db6968e9-91f3-4b2a-b045-adf62b8774f3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:57.943255 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-db6968e9-91f3-4b2a-b045-adf62b8774f3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:58.146870 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-db6968e9-91f3-4b2a-b045-adf62b8774f3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:58.154962 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-db6968e9-91f3-4b2a-b045-adf62b8774f3 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1554 microversion: 2.1 time: 0.228460 Jul 27 04:22:58.155500 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 69/150] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:57 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:58.623531 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4bbb31a4-f852-444d-af16-9820645fd44d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:58.624704 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4bbb31a4-f852-444d-af16-9820645fd44d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:58.651003 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4bbb31a4-f852-444d-af16-9820645fd44d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:58.651604 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4bbb31a4-f852-444d-af16-9820645fd44d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:58.653477 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4bbb31a4-f852-444d-af16-9820645fd44d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:58.654178 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4bbb31a4-f852-444d-af16-9820645fd44d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:59.138257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4bbb31a4-f852-444d-af16-9820645fd44d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:59.151872 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4bbb31a4-f852-444d-af16-9820645fd44d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.534373 Jul 27 04:22:59.165841 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 82/151] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:58 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:22:59.183073 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ee0c5deb-6971-4b18-a24a-9c6bde84e370 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:22:59.183702 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ee0c5deb-6971-4b18-a24a-9c6bde84e370 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:22:59.191814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ee0c5deb-6971-4b18-a24a-9c6bde84e370 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:59.192261 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ee0c5deb-6971-4b18-a24a-9c6bde84e370 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:59.193103 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ee0c5deb-6971-4b18-a24a-9c6bde84e370 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:22:59.193748 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ee0c5deb-6971-4b18-a24a-9c6bde84e370 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:22:59.375698 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ee0c5deb-6971-4b18-a24a-9c6bde84e370 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:22:59.387335 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ee0c5deb-6971-4b18-a24a-9c6bde84e370 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1554 microversion: 2.1 time: 0.210293 Jul 27 04:22:59.388414 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 70/152] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:22:59 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:00.183491 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-2890f3fa-800c-46f2-98e4-a7c1c632ee81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:00.184717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-2890f3fa-800c-46f2-98e4-a7c1c632ee81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:00.235877 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2890f3fa-800c-46f2-98e4-a7c1c632ee81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:00.236703 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2890f3fa-800c-46f2-98e4-a7c1c632ee81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:00.238191 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2890f3fa-800c-46f2-98e4-a7c1c632ee81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:00.238940 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2890f3fa-800c-46f2-98e4-a7c1c632ee81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:00.322181 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-5e240575-1791-48e3-bd1e-d260a805a83b req-2b5d1335-ce7c-40ae-b0ce-b8307f4424b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9878f853-653a-4dbc-beb5-e1191e7c3e5f", "name": "network-vif-deleted", "tag": "32e0b1d6-6e4d-40a3-8ab0-ac75771d2bfc"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:23:00.362286 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-5e240575-1791-48e3-bd1e-d260a805a83b req-2b5d1335-ce7c-40ae-b0ce-b8307f4424b3 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:00.363097 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-5e240575-1791-48e3-bd1e-d260a805a83b req-2b5d1335-ce7c-40ae-b0ce-b8307f4424b3 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:00.411139 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-5e240575-1791-48e3-bd1e-d260a805a83b req-2b5d1335-ce7c-40ae-b0ce-b8307f4424b3 service nova] Creating event network-vif-deleted:32e0b1d6-6e4d-40a3-8ab0-ac75771d2bfc for instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f on hv-cinder-85098 Jul 27 04:23:00.421773 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-5e240575-1791-48e3-bd1e-d260a805a83b req-2b5d1335-ce7c-40ae-b0ce-b8307f4424b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106686 Jul 27 04:23:00.424967 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 71/153] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:23:00.436227 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c5c3513f-75d1-44f7-a677-83627354a0b0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:00.440565 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c5c3513f-75d1-44f7-a677-83627354a0b0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:00.460936 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c5c3513f-75d1-44f7-a677-83627354a0b0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:00.465352 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c5c3513f-75d1-44f7-a677-83627354a0b0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:00.466663 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c5c3513f-75d1-44f7-a677-83627354a0b0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:00.467306 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c5c3513f-75d1-44f7-a677-83627354a0b0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:00.507271 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-2890f3fa-800c-46f2-98e4-a7c1c632ee81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:00.516253 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-2890f3fa-800c-46f2-98e4-a7c1c632ee81 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.345392 Jul 27 04:23:00.529909 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 83/154] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:00 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:00.562847 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c5c3513f-75d1-44f7-a677-83627354a0b0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a430d7aa4dcf40e399fcb5d1f4bf3f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c14d53ffc0d4d90b7cbfbb6b3b5a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:00.573295 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c5c3513f-75d1-44f7-a677-83627354a0b0 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 200 len: 1346 microversion: 2.1 time: 0.147048 Jul 27 04:23:00.573930 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 72/155] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:00 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 1346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:01.538654 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-5908bb3a-2283-483b-b44c-d1fbebf9460b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:01.539376 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-5908bb3a-2283-483b-b44c-d1fbebf9460b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:01.557590 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5908bb3a-2283-483b-b44c-d1fbebf9460b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:01.559909 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5908bb3a-2283-483b-b44c-d1fbebf9460b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:01.563554 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5908bb3a-2283-483b-b44c-d1fbebf9460b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:01.565098 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5908bb3a-2283-483b-b44c-d1fbebf9460b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:01.594791 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4054f640-77b4-4620-8df1-7904ae6074c8 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:01.595381 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4054f640-77b4-4620-8df1-7904ae6074c8 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:01.604583 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4054f640-77b4-4620-8df1-7904ae6074c8 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:01.605049 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4054f640-77b4-4620-8df1-7904ae6074c8 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:01.605854 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4054f640-77b4-4620-8df1-7904ae6074c8 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:01.606325 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4054f640-77b4-4620-8df1-7904ae6074c8 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:01.625321 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=100 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:01.647958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-4054f640-77b4-4620-8df1-7904ae6074c8 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] HTTP exception thrown: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4054f640-77b4-4620-8df1-7904ae6074c8 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Request method failure captured: Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f HTTP/1.1 Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L1b0ps65uQRhdtzm3ky1kxN2KZ2NBR7mnO7zSvqexmxAw9850T4dISxj6lJc3PiqKeJKIRQ8_Ew1F7fQ0avycqMgsJ83iJ52EGMkicsaZ7vC3EiXOgyhXf_4Fo45dw0C1XdBZX81LvhOY1vJbzDXjsDJKSAMQZuj4OIfHoupxT4seg Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: 7c14d53ffc0d4d90b7cbfbb6b3b5a83b Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-DeleteServersTestJSON-2112232976 Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:23:01.652656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:23:01.654689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:23:01.654689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-DeleteServersTestJSON-2112232976 Jul 27 04:23:01.654689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: 7c14d53ffc0d4d90b7cbfbb6b3b5a83b Jul 27 04:23:01.654689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-DeleteServersTestJSON-2112232976 Jul 27 04:23:01.654689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-DeleteServersTestJSON-2112232976-project Jul 27 04:23:01.654689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:23:01.654689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:23:01.654689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: a430d7aa4dcf40e399fcb5d1f4bf3f76 Jul 27 04:23:01.654689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-DeleteServersTestJSON-2112232976-project Jul 27 04:23:01.654689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:23:01.654689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:01.654689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '9878f853-653a-4dbc-beb5-e1191e7c3e5f'} Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:23:01.655628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:01.656918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:01.657884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4054f640-77b4-4620-8df1-7904ae6074c8 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Returning 404 to user: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:23:01.657884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4054f640-77b4-4620-8df1-7904ae6074c8 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 404 len: 111 microversion: 2.1 time: 0.065140 Jul 27 04:23:01.658548 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 73/156] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:01 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 04:23:01.840544 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-5908bb3a-2283-483b-b44c-d1fbebf9460b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:01.849460 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-5908bb3a-2283-483b-b44c-d1fbebf9460b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.316050 Jul 27 04:23:01.861414 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 84/157] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:01 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:02.000427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3c0eed07-e20d-4ce8-ba9d-ca8f8447b11a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:02.003727 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-3c0eed07-e20d-4ce8-ba9d-ca8f8447b11a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:02.016898 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3c0eed07-e20d-4ce8-ba9d-ca8f8447b11a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:02.017569 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3c0eed07-e20d-4ce8-ba9d-ca8f8447b11a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:02.018594 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3c0eed07-e20d-4ce8-ba9d-ca8f8447b11a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:02.019322 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3c0eed07-e20d-4ce8-ba9d-ca8f8447b11a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:02.090701 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-3c0eed07-e20d-4ce8-ba9d-ca8f8447b11a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] HTTP exception thrown: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3c0eed07-e20d-4ce8-ba9d-ca8f8447b11a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Request method failure captured: Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f/os-volume_attachments HTTP/1.1 Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L1b0ps65uQRhdtzm3ky1kxN2KZ2NBR7mnO7zSvqexmxAw9850T4dISxj6lJc3PiqKeJKIRQ8_Ew1F7fQ0avycqMgsJ83iJ52EGMkicsaZ7vC3EiXOgyhXf_4Fo45dw0C1XdBZX81LvhOY1vJbzDXjsDJKSAMQZuj4OIfHoupxT4seg Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: 7c14d53ffc0d4d90b7cbfbb6b3b5a83b Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-DeleteServersTestJSON-2112232976 Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:23:02.092495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:23:02.093721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:23:02.093721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-DeleteServersTestJSON-2112232976 Jul 27 04:23:02.093721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: 7c14d53ffc0d4d90b7cbfbb6b3b5a83b Jul 27 04:23:02.093721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-DeleteServersTestJSON-2112232976 Jul 27 04:23:02.093721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-DeleteServersTestJSON-2112232976-project Jul 27 04:23:02.093721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:23:02.093721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:23:02.093721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: a430d7aa4dcf40e399fcb5d1f4bf3f76 Jul 27 04:23:02.093721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-DeleteServersTestJSON-2112232976-project Jul 27 04:23:02.093721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:23:02.093721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:02.093721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'server_id': '9878f853-653a-4dbc-beb5-e1191e7c3e5f'} Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:23:02.094534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:02.095884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:02.097473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3c0eed07-e20d-4ce8-ba9d-ca8f8447b11a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Returning 404 to user: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:23:02.097473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-3c0eed07-e20d-4ce8-ba9d-ca8f8447b11a tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.099935 Jul 27 04:23:02.097473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 74/158] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:23:01 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f/os-volume_attachments => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:23:02.889307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-5d975ca3-ace4-4251-a061-8090fbdb3712 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:02.890518 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-5d975ca3-ace4-4251-a061-8090fbdb3712 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:02.897200 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5d975ca3-ace4-4251-a061-8090fbdb3712 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:02.897812 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5d975ca3-ace4-4251-a061-8090fbdb3712 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:02.898580 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5d975ca3-ace4-4251-a061-8090fbdb3712 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:02.899051 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5d975ca3-ace4-4251-a061-8090fbdb3712 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:03.045610 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-5d975ca3-ace4-4251-a061-8090fbdb3712 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:03.054122 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-5d975ca3-ace4-4251-a061-8090fbdb3712 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.169490 Jul 27 04:23:03.054885 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 85/159] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:02 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:03.472933 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ec1732aa-ae65-4c94-8295-74c6110f6502 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:03.474142 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ec1732aa-ae65-4c94-8295-74c6110f6502 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:03.481155 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ec1732aa-ae65-4c94-8295-74c6110f6502 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:03.481610 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ec1732aa-ae65-4c94-8295-74c6110f6502 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:03.482422 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ec1732aa-ae65-4c94-8295-74c6110f6502 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:03.483237 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ec1732aa-ae65-4c94-8295-74c6110f6502 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:03.502218 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-ec1732aa-ae65-4c94-8295-74c6110f6502 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] HTTP exception thrown: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ec1732aa-ae65-4c94-8295-74c6110f6502 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Request method failure captured: Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: DELETE /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f HTTP/1.1 Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L1b0ps65uQRhdtzm3ky1kxN2KZ2NBR7mnO7zSvqexmxAw9850T4dISxj6lJc3PiqKeJKIRQ8_Ew1F7fQ0avycqMgsJ83iJ52EGMkicsaZ7vC3EiXOgyhXf_4Fo45dw0C1XdBZX81LvhOY1vJbzDXjsDJKSAMQZuj4OIfHoupxT4seg Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: 7c14d53ffc0d4d90b7cbfbb6b3b5a83b Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-DeleteServersTestJSON-2112232976 Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:23:03.504059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:23:03.505345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:23:03.505345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-DeleteServersTestJSON-2112232976 Jul 27 04:23:03.505345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: 7c14d53ffc0d4d90b7cbfbb6b3b5a83b Jul 27 04:23:03.505345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-DeleteServersTestJSON-2112232976 Jul 27 04:23:03.505345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-DeleteServersTestJSON-2112232976-project Jul 27 04:23:03.505345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:23:03.505345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:23:03.505345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: a430d7aa4dcf40e399fcb5d1f4bf3f76 Jul 27 04:23:03.505345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-DeleteServersTestJSON-2112232976-project Jul 27 04:23:03.505345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:23:03.505345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:03.505345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '9878f853-653a-4dbc-beb5-e1191e7c3e5f'} Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:23:03.509054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:03.510779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:23:03.511880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ec1732aa-ae65-4c94-8295-74c6110f6502 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Returning 404 to user: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:23:03.511880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ec1732aa-ae65-4c94-8295-74c6110f6502 tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 404 len: 111 microversion: 2.1 time: 0.040963 Jul 27 04:23:03.511880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 75/160] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:23:03 2022] DELETE /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:23:03.514069 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-26255a68-1dc0-4c4c-9f65-c5fd35b4981f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:03.514698 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-26255a68-1dc0-4c4c-9f65-c5fd35b4981f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] [instance: 9878f853-653a-4dbc-beb5-e1191e7c3e5f] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:03.520757 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-26255a68-1dc0-4c4c-9f65-c5fd35b4981f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:03.521197 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-26255a68-1dc0-4c4c-9f65-c5fd35b4981f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:03.522057 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-26255a68-1dc0-4c4c-9f65-c5fd35b4981f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:03.522394 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-26255a68-1dc0-4c4c-9f65-c5fd35b4981f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:03.536384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-26255a68-1dc0-4c4c-9f65-c5fd35b4981f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] HTTP exception thrown: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-26255a68-1dc0-4c4c-9f65-c5fd35b4981f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Request method failure captured: Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f HTTP/1.1 Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L1b0ps65uQRhdtzm3ky1kxN2KZ2NBR7mnO7zSvqexmxAw9850T4dISxj6lJc3PiqKeJKIRQ8_Ew1F7fQ0avycqMgsJ83iJ52EGMkicsaZ7vC3EiXOgyhXf_4Fo45dw0C1XdBZX81LvhOY1vJbzDXjsDJKSAMQZuj4OIfHoupxT4seg Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 7c14d53ffc0d4d90b7cbfbb6b3b5a83b Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-DeleteServersTestJSON-2112232976 Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:23:03.544919 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:23:03.546363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c14d53ffc0d4d90b7cbfbb6b3b5a83b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:23:03.546363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-DeleteServersTestJSON-2112232976 Jul 27 04:23:03.546363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 7c14d53ffc0d4d90b7cbfbb6b3b5a83b Jul 27 04:23:03.546363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-DeleteServersTestJSON-2112232976 Jul 27 04:23:03.546363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-DeleteServersTestJSON-2112232976-project Jul 27 04:23:03.546363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:23:03.546363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:23:03.546363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: a430d7aa4dcf40e399fcb5d1f4bf3f76 Jul 27 04:23:03.546363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-DeleteServersTestJSON-2112232976-project Jul 27 04:23:03.546363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:23:03.546363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:03.546363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '9878f853-653a-4dbc-beb5-e1191e7c3e5f'} Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:23:03.547093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. Jul 27 04:23:03.548466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:23:03.549517 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-26255a68-1dc0-4c4c-9f65-c5fd35b4981f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] Returning 404 to user: Instance 9878f853-653a-4dbc-beb5-e1191e7c3e5f could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:23:03.549517 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-26255a68-1dc0-4c4c-9f65-c5fd35b4981f tempest-DeleteServersTestJSON-2112232976 tempest-DeleteServersTestJSON-2112232976-project] 10.222.0.46 "GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f" status: 404 len: 111 microversion: 2.1 time: 0.036372 Jul 27 04:23:03.549517 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 86/161] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:03 2022] GET /compute/v2.1/servers/9878f853-653a-4dbc-beb5-e1191e7c3e5f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:23:04.086191 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c6c8fa1c-80ba-4562-baec-7a4cb89ff17e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:04.106744 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c6c8fa1c-80ba-4562-baec-7a4cb89ff17e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:04.115814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c6c8fa1c-80ba-4562-baec-7a4cb89ff17e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:04.116659 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c6c8fa1c-80ba-4562-baec-7a4cb89ff17e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:04.117913 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c6c8fa1c-80ba-4562-baec-7a4cb89ff17e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:04.118801 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c6c8fa1c-80ba-4562-baec-7a4cb89ff17e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:04.430622 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c6c8fa1c-80ba-4562-baec-7a4cb89ff17e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:04.444039 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c6c8fa1c-80ba-4562-baec-7a4cb89ff17e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.367945 Jul 27 04:23:04.444942 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 76/162] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:04 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:23:05.475271 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-669e4aea-a266-4e87-ab60-d21f8ce597a0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:05.475980 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-669e4aea-a266-4e87-ab60-d21f8ce597a0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:05.483804 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-669e4aea-a266-4e87-ab60-d21f8ce597a0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:05.484453 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-669e4aea-a266-4e87-ab60-d21f8ce597a0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:05.485133 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-669e4aea-a266-4e87-ab60-d21f8ce597a0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:05.485634 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-669e4aea-a266-4e87-ab60-d21f8ce597a0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:05.864676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-669e4aea-a266-4e87-ab60-d21f8ce597a0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:05.886652 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-669e4aea-a266-4e87-ab60-d21f8ce597a0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.415579 Jul 27 04:23:05.888121 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 87/163] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:05 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:06.910054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-688a50ca-44a4-46ba-9edd-7cb386e8cb2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:06.910878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-688a50ca-44a4-46ba-9edd-7cb386e8cb2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:06.921416 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-688a50ca-44a4-46ba-9edd-7cb386e8cb2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:06.922399 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-688a50ca-44a4-46ba-9edd-7cb386e8cb2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:06.925500 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-688a50ca-44a4-46ba-9edd-7cb386e8cb2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:06.925500 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-688a50ca-44a4-46ba-9edd-7cb386e8cb2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:07.157882 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-688a50ca-44a4-46ba-9edd-7cb386e8cb2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:07.168379 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-688a50ca-44a4-46ba-9edd-7cb386e8cb2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.263494 Jul 27 04:23:07.169952 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 77/164] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:06 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:08.198077 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-85b268e5-d71b-44de-ab5b-957791fb3359 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:08.201356 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-85b268e5-d71b-44de-ab5b-957791fb3359 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:08.215398 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-85b268e5-d71b-44de-ab5b-957791fb3359 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:08.217584 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-85b268e5-d71b-44de-ab5b-957791fb3359 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:08.218657 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-85b268e5-d71b-44de-ab5b-957791fb3359 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:08.233357 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-85b268e5-d71b-44de-ab5b-957791fb3359 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:08.869631 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-85b268e5-d71b-44de-ab5b-957791fb3359 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:08.879553 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-85b268e5-d71b-44de-ab5b-957791fb3359 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.687250 Jul 27 04:23:08.897639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 88/165] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:08 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:09.902739 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ee2e2231-40d5-4f6d-a102-4198a4596fd6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:09.904087 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ee2e2231-40d5-4f6d-a102-4198a4596fd6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:09.912614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ee2e2231-40d5-4f6d-a102-4198a4596fd6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:09.913421 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ee2e2231-40d5-4f6d-a102-4198a4596fd6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:09.914646 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ee2e2231-40d5-4f6d-a102-4198a4596fd6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:09.915470 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ee2e2231-40d5-4f6d-a102-4198a4596fd6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:10.204354 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ee2e2231-40d5-4f6d-a102-4198a4596fd6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:10.215639 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ee2e2231-40d5-4f6d-a102-4198a4596fd6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.318456 Jul 27 04:23:10.216385 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 78/166] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:09 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:11.242719 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4b8ab07d-c9fa-4158-998e-82c16cdf756f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:11.244792 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4b8ab07d-c9fa-4158-998e-82c16cdf756f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:11.275876 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4b8ab07d-c9fa-4158-998e-82c16cdf756f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:11.276349 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4b8ab07d-c9fa-4158-998e-82c16cdf756f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:11.277127 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4b8ab07d-c9fa-4158-998e-82c16cdf756f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:11.277610 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4b8ab07d-c9fa-4158-998e-82c16cdf756f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:11.516733 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4b8ab07d-c9fa-4158-998e-82c16cdf756f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:11.533634 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4b8ab07d-c9fa-4158-998e-82c16cdf756f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.297474 Jul 27 04:23:11.535290 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 89/167] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:11 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:11.574551 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1873962076", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "networks": [{"uuid": "478b4ed1-67de-4059-a9f2-3b59a8e77b95"}]}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:23:12.567203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-6f582d3b-428d-43e5-8213-2726d64bf25e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:12.568072 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-6f582d3b-428d-43e5-8213-2726d64bf25e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:12.586101 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6f582d3b-428d-43e5-8213-2726d64bf25e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:12.587923 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6f582d3b-428d-43e5-8213-2726d64bf25e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:12.590031 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6f582d3b-428d-43e5-8213-2726d64bf25e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:12.590790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6f582d3b-428d-43e5-8213-2726d64bf25e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:12.609105 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] validate_networks() for [('478b4ed1-67de-4059-a9f2-3b59a8e77b95', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:23:12.908617 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-6f582d3b-428d-43e5-8213-2726d64bf25e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:12.917438 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-6f582d3b-428d-43e5-8213-2726d64bf25e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.363683 Jul 27 04:23:12.930755 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 90/168] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:12 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:23:13.269044 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:23:13.269374 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:23:13.270143 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:23:13.270912 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:23:13.271306 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:23:13.282885 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:13.283787 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:13.285624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:13.286059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:13.308752 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Getting quotas for project a4c6bc5f81ac457dbb91c5bc1a8f0d61. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:23:13.312870 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Getting quotas for user 937a7097c9d84402882f73082cfa408f and project a4c6bc5f81ac457dbb91c5bc1a8f0d61. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:23:13.326046 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:23:13.328472 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:23:13.401649 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-10ea1856-577f-4bf1-803f-318ca0b14c52 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.834669 Jul 27 04:23:13.402478 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 79/169] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:23:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:23:13.414412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4043a7b4-b13a-499b-bc05-46c5280cd8e5 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:13.415033 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4043a7b4-b13a-499b-bc05-46c5280cd8e5 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:13.552837 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4043a7b4-b13a-499b-bc05-46c5280cd8e5 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:13.561248 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4043a7b4-b13a-499b-bc05-46c5280cd8e5 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1219 microversion: 2.1 time: 0.151183 Jul 27 04:23:13.573152 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 91/170] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:13 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:13.948648 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7d9eaf4f-93c1-49d0-a0ea-102aea871b6d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:13.950885 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-7d9eaf4f-93c1-49d0-a0ea-102aea871b6d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:13.973341 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7d9eaf4f-93c1-49d0-a0ea-102aea871b6d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:13.973996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7d9eaf4f-93c1-49d0-a0ea-102aea871b6d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:13.975002 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7d9eaf4f-93c1-49d0-a0ea-102aea871b6d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:13.975643 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7d9eaf4f-93c1-49d0-a0ea-102aea871b6d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:14.250669 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-7d9eaf4f-93c1-49d0-a0ea-102aea871b6d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:14.283842 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-7d9eaf4f-93c1-49d0-a0ea-102aea871b6d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.327620 Jul 27 04:23:14.285645 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 80/171] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:13 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:14.586954 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-20e9009f-cc56-4a64-965d-029ea768eba0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:14.590042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-20e9009f-cc56-4a64-965d-029ea768eba0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:14.599801 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-20e9009f-cc56-4a64-965d-029ea768eba0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:14.600616 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-20e9009f-cc56-4a64-965d-029ea768eba0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:14.608067 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-20e9009f-cc56-4a64-965d-029ea768eba0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:14.609036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-20e9009f-cc56-4a64-965d-029ea768eba0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:14.863683 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-20e9009f-cc56-4a64-965d-029ea768eba0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:14.872133 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-20e9009f-cc56-4a64-965d-029ea768eba0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1271 microversion: 2.1 time: 0.291597 Jul 27 04:23:14.885740 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 92/172] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:14 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1271 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:15.313940 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8c7134d6-1e4d-46be-a7e2-1517e889c574 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:15.315202 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8c7134d6-1e4d-46be-a7e2-1517e889c574 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:15.324055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8c7134d6-1e4d-46be-a7e2-1517e889c574 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:15.324743 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8c7134d6-1e4d-46be-a7e2-1517e889c574 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:15.325963 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8c7134d6-1e4d-46be-a7e2-1517e889c574 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:15.326579 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8c7134d6-1e4d-46be-a7e2-1517e889c574 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:15.596617 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8c7134d6-1e4d-46be-a7e2-1517e889c574 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:15.609295 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8c7134d6-1e4d-46be-a7e2-1517e889c574 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.302747 Jul 27 04:23:15.611614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 81/173] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:15 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:15.895985 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9b04c14c-81c1-40ac-bfc5-f5c1b6e53fc4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:15.897942 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-9b04c14c-81c1-40ac-bfc5-f5c1b6e53fc4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:15.921557 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9b04c14c-81c1-40ac-bfc5-f5c1b6e53fc4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:15.922046 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9b04c14c-81c1-40ac-bfc5-f5c1b6e53fc4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:15.939141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9b04c14c-81c1-40ac-bfc5-f5c1b6e53fc4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:15.939474 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9b04c14c-81c1-40ac-bfc5-f5c1b6e53fc4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:16.078634 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-9b04c14c-81c1-40ac-bfc5-f5c1b6e53fc4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:16.091300 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-9b04c14c-81c1-40ac-bfc5-f5c1b6e53fc4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1277 microversion: 2.1 time: 0.201743 Jul 27 04:23:16.092625 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 93/174] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:15 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:16.639451 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e3d87c8b-fdf2-4192-a484-3e8176b83f54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:16.640654 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e3d87c8b-fdf2-4192-a484-3e8176b83f54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:16.648299 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e3d87c8b-fdf2-4192-a484-3e8176b83f54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:16.650641 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e3d87c8b-fdf2-4192-a484-3e8176b83f54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:16.652718 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e3d87c8b-fdf2-4192-a484-3e8176b83f54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:16.655340 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e3d87c8b-fdf2-4192-a484-3e8176b83f54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:16.867399 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e3d87c8b-fdf2-4192-a484-3e8176b83f54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:16.877638 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e3d87c8b-fdf2-4192-a484-3e8176b83f54 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.248336 Jul 27 04:23:16.878722 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 82/175] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:16 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:17.113851 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0373143e-c6e6-4afa-b365-fbcbec3778fa tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:17.115058 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0373143e-c6e6-4afa-b365-fbcbec3778fa tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:17.125013 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0373143e-c6e6-4afa-b365-fbcbec3778fa tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:17.125671 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0373143e-c6e6-4afa-b365-fbcbec3778fa tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:17.127583 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0373143e-c6e6-4afa-b365-fbcbec3778fa tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:17.128483 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0373143e-c6e6-4afa-b365-fbcbec3778fa tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:17.397681 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0373143e-c6e6-4afa-b365-fbcbec3778fa tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:17.408459 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0373143e-c6e6-4afa-b365-fbcbec3778fa tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.299258 Jul 27 04:23:17.419219 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 94/176] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:17 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:17.898798 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-de2aa98a-46d7-4661-b7e8-7b76ec543502 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:17.899511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-de2aa98a-46d7-4661-b7e8-7b76ec543502 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:17.914675 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-de2aa98a-46d7-4661-b7e8-7b76ec543502 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:17.915686 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-de2aa98a-46d7-4661-b7e8-7b76ec543502 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:17.917136 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-de2aa98a-46d7-4661-b7e8-7b76ec543502 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:17.918073 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-de2aa98a-46d7-4661-b7e8-7b76ec543502 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:18.071727 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-de2aa98a-46d7-4661-b7e8-7b76ec543502 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:18.111973 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-de2aa98a-46d7-4661-b7e8-7b76ec543502 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.216766 Jul 27 04:23:18.112579 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 83/177] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:17 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:18.433020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-cd76847d-69c3-4ff1-bd88-76651b48d681 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:18.434553 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-cd76847d-69c3-4ff1-bd88-76651b48d681 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:18.444327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:18.447777 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cd76847d-69c3-4ff1-bd88-76651b48d681 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:18.448715 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cd76847d-69c3-4ff1-bd88-76651b48d681 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:18.449549 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cd76847d-69c3-4ff1-bd88-76651b48d681 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:18.450169 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cd76847d-69c3-4ff1-bd88-76651b48d681 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:18.457673 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:18.675054 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-cd76847d-69c3-4ff1-bd88-76651b48d681 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:18.684051 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-cd76847d-69c3-4ff1-bd88-76651b48d681 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.256865 Jul 27 04:23:18.684622 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 95/178] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:18 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:19.001566 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-fe2bb070-8052-4b39-877f-cf5cb9b39158 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Action: 'create', calling method: .version_select at 0x7f21d669a5e0>, body: {"keypair": {"name": "tempest-keypair-2044162052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMygXhBybStV7/b7Cfoa2F2O1dWd/R/db+BytGQl5N44cZMu3SB4k4/vYlfjvm4Iz3v1ws7bNJtCdQlWKAd3ivibVSKt9CxwuJOb8PAAsC/66Brnmt7bqWf04cReQVdRA=="}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:23:19.009010 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:19.029224 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-fe2bb070-8052-4b39-877f-cf5cb9b39158 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Getting quotas for project 243e75013f5f49e88df72564ac0d2fe7. Resources: {'key_pairs'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:23:19.033140 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-fe2bb070-8052-4b39-877f-cf5cb9b39158 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Getting quotas for user 0eaa342a6bc84529a5d252c7a9a161ba and project 243e75013f5f49e88df72564ac0d2fe7. Resources: {'key_pairs'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:23:19.071370 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-fe2bb070-8052-4b39-877f-cf5cb9b39158 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.249660 Jul 27 04:23:19.071974 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 84/179] 10.222.0.46 () {62 vars in 1200 bytes} [Wed Jul 27 04:23:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 251 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 27 04:23:19.135414 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-cb5448f0-01b4-4c95-af19-1d0da9e0692b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:19.136191 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-cb5448f0-01b4-4c95-af19-1d0da9e0692b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:19.144200 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cb5448f0-01b4-4c95-af19-1d0da9e0692b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:19.144865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cb5448f0-01b4-4c95-af19-1d0da9e0692b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:19.145740 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cb5448f0-01b4-4c95-af19-1d0da9e0692b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:19.146811 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cb5448f0-01b4-4c95-af19-1d0da9e0692b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:19.376050 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-cb5448f0-01b4-4c95-af19-1d0da9e0692b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:19.387944 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-cb5448f0-01b4-4c95-af19-1d0da9e0692b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.258934 Jul 27 04:23:19.388663 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 96/180] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:19 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:19.705049 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-16c79422-9a7e-4cbe-a3ef-8eabdec9a3cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:19.705651 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-16c79422-9a7e-4cbe-a3ef-8eabdec9a3cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:19.712541 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-16c79422-9a7e-4cbe-a3ef-8eabdec9a3cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:19.713759 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-16c79422-9a7e-4cbe-a3ef-8eabdec9a3cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:19.714952 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-16c79422-9a7e-4cbe-a3ef-8eabdec9a3cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:19.715582 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-16c79422-9a7e-4cbe-a3ef-8eabdec9a3cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:19.730698 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-f4a53bc3-4312-486c-824f-2461008048a7 req-fbd18e0e-b0f1-47d4-872f-a12791841afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aadf0a0b-7c0d-4640-aef4-aeb891aebca7", "tag": "b68c0a7d-2c9e-465f-8f30-414ec22bf612"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:23:19.754938 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-f4a53bc3-4312-486c-824f-2461008048a7 req-fbd18e0e-b0f1-47d4-872f-a12791841afc service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:19.757253 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-f4a53bc3-4312-486c-824f-2461008048a7 req-fbd18e0e-b0f1-47d4-872f-a12791841afc service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:19.770059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-f4a53bc3-4312-486c-824f-2461008048a7 req-fbd18e0e-b0f1-47d4-872f-a12791841afc service nova] Creating event network-changed:b68c0a7d-2c9e-465f-8f30-414ec22bf612 for instance aadf0a0b-7c0d-4640-aef4-aeb891aebca7 on hv-cinder-85098 Jul 27 04:23:19.777060 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-f4a53bc3-4312-486c-824f-2461008048a7 req-fbd18e0e-b0f1-47d4-872f-a12791841afc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051287 Jul 27 04:23:19.778224 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 97/181] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:23:19.986902 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-16c79422-9a7e-4cbe-a3ef-8eabdec9a3cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:20.004051 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-16c79422-9a7e-4cbe-a3ef-8eabdec9a3cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.301805 Jul 27 04:23:20.021418 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 85/182] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:19 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:20.412693 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e94ff08e-7fb8-4998-bcd8-69c36705a2c6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:20.413952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e94ff08e-7fb8-4998-bcd8-69c36705a2c6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:20.424737 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e94ff08e-7fb8-4998-bcd8-69c36705a2c6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:20.428438 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e94ff08e-7fb8-4998-bcd8-69c36705a2c6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:20.429421 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e94ff08e-7fb8-4998-bcd8-69c36705a2c6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:20.430094 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e94ff08e-7fb8-4998-bcd8-69c36705a2c6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:20.806892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e94ff08e-7fb8-4998-bcd8-69c36705a2c6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:20.826645 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e94ff08e-7fb8-4998-bcd8-69c36705a2c6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.419748 Jul 27 04:23:20.847266 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 98/183] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:20 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:21.029806 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-325729981", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1955f4b1-9680-4302-bec5-883bf41fbdb1"}], "security_groups": [{"name": "tempest-securitygroup--1156799042"}], "key_name": "tempest-keypair-2044162052", "user_data": "}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:23:21.035292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-bb435223-bc7e-4a8a-891b-3ed4a5d69389 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:21.036904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-bb435223-bc7e-4a8a-891b-3ed4a5d69389 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:21.048960 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bb435223-bc7e-4a8a-891b-3ed4a5d69389 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:21.051993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bb435223-bc7e-4a8a-891b-3ed4a5d69389 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:21.052983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bb435223-bc7e-4a8a-891b-3ed4a5d69389 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:21.068990 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bb435223-bc7e-4a8a-891b-3ed4a5d69389 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:21.208581 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] validate_networks() for [('1955f4b1-9680-4302-bec5-883bf41fbdb1', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:23:21.384336 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-bb435223-bc7e-4a8a-891b-3ed4a5d69389 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:21.397261 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-bb435223-bc7e-4a8a-891b-3ed4a5d69389 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.369572 Jul 27 04:23:21.397844 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 99/184] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:21 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:21.728107 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:23:21.729139 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:23:21.729629 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:23:21.730107 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:23:21.730684 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:23:21.740939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:21.741869 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:21.742848 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:21.743435 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:21.764493 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Getting quotas for project 243e75013f5f49e88df72564ac0d2fe7. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:23:21.769107 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Getting quotas for user 0eaa342a6bc84529a5d252c7a9a161ba and project 243e75013f5f49e88df72564ac0d2fe7. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:23:21.782822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:23:21.785186 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:23:21.855893 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-08fefda7-c35f-4817-b0de-96e6b5a4fdde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:21.856998 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-08fefda7-c35f-4817-b0de-96e6b5a4fdde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:21.867147 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-473388aa-7c03-4a77-beae-878b1923f723 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.842841 Jul 27 04:23:21.873527 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 86/185] 10.222.0.46 () {62 vars in 1188 bytes} [Wed Jul 27 04:23:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 04:23:21.878713 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2e610c17-bc91-405d-a1f8-2bedd14e1c1e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:21.879333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2e610c17-bc91-405d-a1f8-2bedd14e1c1e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:21.881401 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-08fefda7-c35f-4817-b0de-96e6b5a4fdde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:21.884169 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-08fefda7-c35f-4817-b0de-96e6b5a4fdde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:21.885880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-08fefda7-c35f-4817-b0de-96e6b5a4fdde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:21.886566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-08fefda7-c35f-4817-b0de-96e6b5a4fdde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:21.985213 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2e610c17-bc91-405d-a1f8-2bedd14e1c1e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:21.992985 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2e610c17-bc91-405d-a1f8-2bedd14e1c1e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:21.994557 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2e610c17-bc91-405d-a1f8-2bedd14e1c1e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:21.995687 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2e610c17-bc91-405d-a1f8-2bedd14e1c1e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1281 microversion: 2.20 time: 0.120855 Jul 27 04:23:21.998210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 87/186] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:21 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1281 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:23:22.107682 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-08fefda7-c35f-4817-b0de-96e6b5a4fdde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:22.117142 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-08fefda7-c35f-4817-b0de-96e6b5a4fdde tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.266023 Jul 27 04:23:22.117720 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 100/187] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:21 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:23:22.421909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2778da58-72a8-4e24-bf80-844c3c44256b tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:22.422550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2778da58-72a8-4e24-bf80-844c3c44256b tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:22.430833 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2778da58-72a8-4e24-bf80-844c3c44256b tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:22.431566 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2778da58-72a8-4e24-bf80-844c3c44256b tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:22.433376 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2778da58-72a8-4e24-bf80-844c3c44256b tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:22.434385 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2778da58-72a8-4e24-bf80-844c3c44256b tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:22.577738 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2778da58-72a8-4e24-bf80-844c3c44256b tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:22.585809 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2778da58-72a8-4e24-bf80-844c3c44256b tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.167789 Jul 27 04:23:22.586531 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 88/188] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:22 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:23.039937 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-028aafdc-887c-40ae-a41e-6e9474d0c415 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:23.040510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-028aafdc-887c-40ae-a41e-6e9474d0c415 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:23.047380 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-028aafdc-887c-40ae-a41e-6e9474d0c415 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:23.047828 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-028aafdc-887c-40ae-a41e-6e9474d0c415 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:23.048591 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-028aafdc-887c-40ae-a41e-6e9474d0c415 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:23.049023 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-028aafdc-887c-40ae-a41e-6e9474d0c415 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:23.113914 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-028aafdc-887c-40ae-a41e-6e9474d0c415 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:23.122345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-028aafdc-887c-40ae-a41e-6e9474d0c415 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:23.123842 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-028aafdc-887c-40ae-a41e-6e9474d0c415 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:23.124926 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-028aafdc-887c-40ae-a41e-6e9474d0c415 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1285 microversion: 2.20 time: 0.089011 Jul 27 04:23:23.125479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 101/189] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:23 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:23.138683 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d1a6acd4-14f4-4723-933f-87eb2f4a6256 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:23.139472 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d1a6acd4-14f4-4723-933f-87eb2f4a6256 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:23.145379 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d1a6acd4-14f4-4723-933f-87eb2f4a6256 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:23.145827 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d1a6acd4-14f4-4723-933f-87eb2f4a6256 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:23.146622 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d1a6acd4-14f4-4723-933f-87eb2f4a6256 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:23.147057 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d1a6acd4-14f4-4723-933f-87eb2f4a6256 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:23.277268 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d1a6acd4-14f4-4723-933f-87eb2f4a6256 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:23.284737 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d1a6acd4-14f4-4723-933f-87eb2f4a6256 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.149948 Jul 27 04:23:23.285295 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 89/190] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:23 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:23.607777 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8f00dd05-5eb4-445d-b1c4-e9da71bf2c27 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:23.608392 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-8f00dd05-5eb4-445d-b1c4-e9da71bf2c27 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:23.610341 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:23.615927 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8f00dd05-5eb4-445d-b1c4-e9da71bf2c27 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:23.616368 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8f00dd05-5eb4-445d-b1c4-e9da71bf2c27 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:23.617126 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8f00dd05-5eb4-445d-b1c4-e9da71bf2c27 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:23.617557 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8f00dd05-5eb4-445d-b1c4-e9da71bf2c27 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:23.746580 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-8f00dd05-5eb4-445d-b1c4-e9da71bf2c27 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:23.754157 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8f00dd05-5eb4-445d-b1c4-e9da71bf2c27 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.150768 Jul 27 04:23:23.754734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 102/191] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:23 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:24.147151 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9bcb7eee-d813-4629-8b58-dd65206503ac tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:24.147759 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9bcb7eee-d813-4629-8b58-dd65206503ac tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:24.154463 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bcb7eee-d813-4629-8b58-dd65206503ac tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:24.154927 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bcb7eee-d813-4629-8b58-dd65206503ac tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:24.155703 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bcb7eee-d813-4629-8b58-dd65206503ac tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:24.156216 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bcb7eee-d813-4629-8b58-dd65206503ac tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:24.220189 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9bcb7eee-d813-4629-8b58-dd65206503ac tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:24.228376 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9bcb7eee-d813-4629-8b58-dd65206503ac tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:24.229899 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9bcb7eee-d813-4629-8b58-dd65206503ac tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:24.231034 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9bcb7eee-d813-4629-8b58-dd65206503ac tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1333 microversion: 2.20 time: 0.088120 Jul 27 04:23:24.231582 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 90/192] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:24 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:23:24.306144 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7fe5620b-14a6-4770-9204-bc92d4816b56 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:24.307537 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-7fe5620b-14a6-4770-9204-bc92d4816b56 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:24.314308 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7fe5620b-14a6-4770-9204-bc92d4816b56 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:24.314763 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7fe5620b-14a6-4770-9204-bc92d4816b56 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:24.315534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7fe5620b-14a6-4770-9204-bc92d4816b56 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:24.315971 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7fe5620b-14a6-4770-9204-bc92d4816b56 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:24.447789 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-7fe5620b-14a6-4770-9204-bc92d4816b56 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:24.455530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-7fe5620b-14a6-4770-9204-bc92d4816b56 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1521 microversion: 2.1 time: 0.153330 Jul 27 04:23:24.456161 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 103/193] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:24 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:24.774834 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9bde0597-35db-4314-86e3-3de62d25e972 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:24.775957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9bde0597-35db-4314-86e3-3de62d25e972 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:24.781994 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bde0597-35db-4314-86e3-3de62d25e972 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:24.782465 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bde0597-35db-4314-86e3-3de62d25e972 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:24.783228 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bde0597-35db-4314-86e3-3de62d25e972 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:24.783662 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bde0597-35db-4314-86e3-3de62d25e972 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:24.913333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9bde0597-35db-4314-86e3-3de62d25e972 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:24.921649 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9bde0597-35db-4314-86e3-3de62d25e972 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.150537 Jul 27 04:23:24.922263 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 91/194] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:24 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:25.256816 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-92852e19-d862-4364-a146-c87860f9cc4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:25.257442 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-92852e19-d862-4364-a146-c87860f9cc4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:25.264922 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-92852e19-d862-4364-a146-c87860f9cc4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:25.265720 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-92852e19-d862-4364-a146-c87860f9cc4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:25.266578 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-92852e19-d862-4364-a146-c87860f9cc4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:25.267243 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-92852e19-d862-4364-a146-c87860f9cc4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:25.344135 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-92852e19-d862-4364-a146-c87860f9cc4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:25.352661 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-92852e19-d862-4364-a146-c87860f9cc4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:25.355037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-92852e19-d862-4364-a146-c87860f9cc4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:25.356531 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-92852e19-d862-4364-a146-c87860f9cc4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1341 microversion: 2.20 time: 0.103897 Jul 27 04:23:25.357232 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 104/195] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:25 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1341 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:25.476594 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-76a6e819-1775-4815-b6f1-88f6e798ee31 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:25.477198 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-76a6e819-1775-4815-b6f1-88f6e798ee31 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:25.483847 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-76a6e819-1775-4815-b6f1-88f6e798ee31 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:25.484289 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-76a6e819-1775-4815-b6f1-88f6e798ee31 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:25.485047 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-76a6e819-1775-4815-b6f1-88f6e798ee31 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:25.485588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-76a6e819-1775-4815-b6f1-88f6e798ee31 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:25.643572 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-76a6e819-1775-4815-b6f1-88f6e798ee31 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:25.652830 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-76a6e819-1775-4815-b6f1-88f6e798ee31 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1501 microversion: 2.1 time: 0.180042 Jul 27 04:23:25.653343 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 92/196] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:25 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1501 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:25.678598 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9070f78b-f6e4-44e4-8bb5-ff405e75c836 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:25.679370 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-9070f78b-f6e4-44e4-8bb5-ff405e75c836 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:25.686121 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9070f78b-f6e4-44e4-8bb5-ff405e75c836 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:25.686772 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9070f78b-f6e4-44e4-8bb5-ff405e75c836 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:25.687967 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9070f78b-f6e4-44e4-8bb5-ff405e75c836 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:25.688548 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9070f78b-f6e4-44e4-8bb5-ff405e75c836 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:25.945214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6f3b9808-9768-45db-93ce-70963732d694 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:25.946192 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6f3b9808-9768-45db-93ce-70963732d694 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:25.976763 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6f3b9808-9768-45db-93ce-70963732d694 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:25.977336 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6f3b9808-9768-45db-93ce-70963732d694 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:25.980776 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6f3b9808-9768-45db-93ce-70963732d694 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:25.981413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6f3b9808-9768-45db-93ce-70963732d694 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:26.031566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-9070f78b-f6e4-44e4-8bb5-ff405e75c836 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:26.044081 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-9070f78b-f6e4-44e4-8bb5-ff405e75c836 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1516 microversion: 2.1 time: 0.369660 Jul 27 04:23:26.048547 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 105/197] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:25 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1516 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:26.203149 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6f3b9808-9768-45db-93ce-70963732d694 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:26.212046 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6f3b9808-9768-45db-93ce-70963732d694 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.272270 Jul 27 04:23:26.212658 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 93/198] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:25 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:23:26.382950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-95788245-5e91-495c-85fa-5289df2992f4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:26.384458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-95788245-5e91-495c-85fa-5289df2992f4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:26.394177 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-95788245-5e91-495c-85fa-5289df2992f4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:26.394850 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-95788245-5e91-495c-85fa-5289df2992f4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:26.395959 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-95788245-5e91-495c-85fa-5289df2992f4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:26.396739 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-95788245-5e91-495c-85fa-5289df2992f4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:26.495277 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-95788245-5e91-495c-85fa-5289df2992f4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:26.506463 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-95788245-5e91-495c-85fa-5289df2992f4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:26.508004 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-95788245-5e91-495c-85fa-5289df2992f4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:26.509164 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-95788245-5e91-495c-85fa-5289df2992f4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1339 microversion: 2.20 time: 0.132877 Jul 27 04:23:26.510499 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 106/199] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:26 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1339 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:27.232943 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-debe4826-922e-40b0-b389-33ca58ac3567 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:27.233449 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-debe4826-922e-40b0-b389-33ca58ac3567 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:27.241300 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-debe4826-922e-40b0-b389-33ca58ac3567 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:27.241733 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-debe4826-922e-40b0-b389-33ca58ac3567 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:27.242684 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-debe4826-922e-40b0-b389-33ca58ac3567 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:27.243627 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-debe4826-922e-40b0-b389-33ca58ac3567 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:27.388790 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-debe4826-922e-40b0-b389-33ca58ac3567 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:27.396224 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-debe4826-922e-40b0-b389-33ca58ac3567 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.167540 Jul 27 04:23:27.396796 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 94/200] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:27 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:27.532547 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1bfb406c-2457-4117-a3b9-7076f4014774 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:27.533391 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-1bfb406c-2457-4117-a3b9-7076f4014774 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:27.540202 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1bfb406c-2457-4117-a3b9-7076f4014774 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:27.540711 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1bfb406c-2457-4117-a3b9-7076f4014774 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:27.542030 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1bfb406c-2457-4117-a3b9-7076f4014774 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:27.542475 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1bfb406c-2457-4117-a3b9-7076f4014774 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:27.776386 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-1bfb406c-2457-4117-a3b9-7076f4014774 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:27.784280 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-1bfb406c-2457-4117-a3b9-7076f4014774 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:27.785798 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-1bfb406c-2457-4117-a3b9-7076f4014774 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:27.786931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-1bfb406c-2457-4117-a3b9-7076f4014774 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1407 microversion: 2.20 time: 0.258245 Jul 27 04:23:27.787495 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 107/201] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:27 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:28.153182 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-4bdc3980-7ff6-4ee8-97f3-db450a5d1466 req-a53588d8-cae1-45b6-841b-7befcae30212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9478c2cb-a66c-4485-91bf-fe8486025afe", "tag": "d905ab8e-bb09-45aa-9436-9f67042c2d1a"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:23:28.174433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-4bdc3980-7ff6-4ee8-97f3-db450a5d1466 req-a53588d8-cae1-45b6-841b-7befcae30212 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:28.174729 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-4bdc3980-7ff6-4ee8-97f3-db450a5d1466 req-a53588d8-cae1-45b6-841b-7befcae30212 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:28.178961 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=100 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:28.188315 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-4bdc3980-7ff6-4ee8-97f3-db450a5d1466 req-a53588d8-cae1-45b6-841b-7befcae30212 service nova] Creating event network-changed:d905ab8e-bb09-45aa-9436-9f67042c2d1a for instance 9478c2cb-a66c-4485-91bf-fe8486025afe on hv-cinder-85098 Jul 27 04:23:28.193234 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-4bdc3980-7ff6-4ee8-97f3-db450a5d1466 req-a53588d8-cae1-45b6-841b-7befcae30212 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044183 Jul 27 04:23:28.193830 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 95/202] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:23:28.417948 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-171faba9-f208-4215-9147-02ae9cea9c44 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:28.418623 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-171faba9-f208-4215-9147-02ae9cea9c44 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:28.424684 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-171faba9-f208-4215-9147-02ae9cea9c44 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:28.425213 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-171faba9-f208-4215-9147-02ae9cea9c44 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:28.426112 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-171faba9-f208-4215-9147-02ae9cea9c44 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:28.426622 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-171faba9-f208-4215-9147-02ae9cea9c44 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:28.567563 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-171faba9-f208-4215-9147-02ae9cea9c44 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:28.576234 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-171faba9-f208-4215-9147-02ae9cea9c44 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.163241 Jul 27 04:23:28.576796 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 108/203] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:28 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:28.810417 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ff3e4047-f509-4328-a957-6ddc19685692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:28.811043 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ff3e4047-f509-4328-a957-6ddc19685692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:28.817231 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ff3e4047-f509-4328-a957-6ddc19685692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:28.817668 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ff3e4047-f509-4328-a957-6ddc19685692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:28.818443 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ff3e4047-f509-4328-a957-6ddc19685692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:28.818870 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ff3e4047-f509-4328-a957-6ddc19685692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:28.949311 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ff3e4047-f509-4328-a957-6ddc19685692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:28.957445 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ff3e4047-f509-4328-a957-6ddc19685692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:28.958987 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ff3e4047-f509-4328-a957-6ddc19685692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:28.960120 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ff3e4047-f509-4328-a957-6ddc19685692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1407 microversion: 2.20 time: 0.154604 Jul 27 04:23:28.960676 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 96/204] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:28 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:29.596568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3b8ba032-2de1-49f0-b8f6-ddf8389ccc34 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:29.597937 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3b8ba032-2de1-49f0-b8f6-ddf8389ccc34 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:29.605462 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3b8ba032-2de1-49f0-b8f6-ddf8389ccc34 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:29.605916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3b8ba032-2de1-49f0-b8f6-ddf8389ccc34 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:29.606749 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3b8ba032-2de1-49f0-b8f6-ddf8389ccc34 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:29.607188 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3b8ba032-2de1-49f0-b8f6-ddf8389ccc34 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:29.856576 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3b8ba032-2de1-49f0-b8f6-ddf8389ccc34 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:29.863912 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3b8ba032-2de1-49f0-b8f6-ddf8389ccc34 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.271117 Jul 27 04:23:29.864489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 109/205] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:29 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:29.982628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-88a65e15-de9e-4998-9dee-11eba1fb0718 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:29.983322 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-88a65e15-de9e-4998-9dee-11eba1fb0718 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:29.989491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-88a65e15-de9e-4998-9dee-11eba1fb0718 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:29.989934 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-88a65e15-de9e-4998-9dee-11eba1fb0718 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:29.990727 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-88a65e15-de9e-4998-9dee-11eba1fb0718 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:29.991156 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-88a65e15-de9e-4998-9dee-11eba1fb0718 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:30.127241 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-88a65e15-de9e-4998-9dee-11eba1fb0718 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:30.135770 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-88a65e15-de9e-4998-9dee-11eba1fb0718 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:30.137280 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-88a65e15-de9e-4998-9dee-11eba1fb0718 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:30.138401 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-88a65e15-de9e-4998-9dee-11eba1fb0718 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1407 microversion: 2.20 time: 0.159730 Jul 27 04:23:30.139174 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 97/206] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:29 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:30.345120 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-23f89670-0ffb-4357-8193-9d3b7300ee59 req-3af7c9fc-a689-4270-ae08-4dc103844639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aadf0a0b-7c0d-4640-aef4-aeb891aebca7", "name": "network-vif-plugged", "status": "completed", "tag": "b68c0a7d-2c9e-465f-8f30-414ec22bf612"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:23:30.355747 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-23f89670-0ffb-4357-8193-9d3b7300ee59 req-3af7c9fc-a689-4270-ae08-4dc103844639 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:30.356306 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-23f89670-0ffb-4357-8193-9d3b7300ee59 req-3af7c9fc-a689-4270-ae08-4dc103844639 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:30.371579 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-23f89670-0ffb-4357-8193-9d3b7300ee59 req-3af7c9fc-a689-4270-ae08-4dc103844639 service nova] Creating event network-vif-plugged:b68c0a7d-2c9e-465f-8f30-414ec22bf612 for instance aadf0a0b-7c0d-4640-aef4-aeb891aebca7 on hv-cinder-85098 Jul 27 04:23:30.377035 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-23f89670-0ffb-4357-8193-9d3b7300ee59 req-3af7c9fc-a689-4270-ae08-4dc103844639 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035828 Jul 27 04:23:30.381876 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 110/207] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:23:30.883569 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9bb131cb-a882-486d-82e5-2bb33e940a63 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:30.884081 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9bb131cb-a882-486d-82e5-2bb33e940a63 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:30.890289 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bb131cb-a882-486d-82e5-2bb33e940a63 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:30.890754 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bb131cb-a882-486d-82e5-2bb33e940a63 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:30.891504 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bb131cb-a882-486d-82e5-2bb33e940a63 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:30.891930 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bb131cb-a882-486d-82e5-2bb33e940a63 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:31.029263 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9bb131cb-a882-486d-82e5-2bb33e940a63 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:31.036608 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9bb131cb-a882-486d-82e5-2bb33e940a63 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.156902 Jul 27 04:23:31.037175 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 98/208] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:30 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:31.161741 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-5fce403b-983d-40d3-927b-e62ac215eacd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:31.162502 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-5fce403b-983d-40d3-927b-e62ac215eacd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:31.169713 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5fce403b-983d-40d3-927b-e62ac215eacd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:31.170192 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5fce403b-983d-40d3-927b-e62ac215eacd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:31.170967 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5fce403b-983d-40d3-927b-e62ac215eacd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:31.171403 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5fce403b-983d-40d3-927b-e62ac215eacd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:31.337842 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-5fce403b-983d-40d3-927b-e62ac215eacd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:31.347067 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-5fce403b-983d-40d3-927b-e62ac215eacd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:31.348728 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-5fce403b-983d-40d3-927b-e62ac215eacd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:31.349874 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-5fce403b-983d-40d3-927b-e62ac215eacd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1407 microversion: 2.20 time: 0.192956 Jul 27 04:23:31.350581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 111/209] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:31 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:31.719012 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-bc95bbd6-f637-4f66-9130-2b6bce8eebef tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:23:31.721295 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-bc95bbd6-f637-4f66-9130-2b6bce8eebef tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:31.727232 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bc95bbd6-f637-4f66-9130-2b6bce8eebef tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:31.727679 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bc95bbd6-f637-4f66-9130-2b6bce8eebef tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:31.729050 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bc95bbd6-f637-4f66-9130-2b6bce8eebef tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:31.729481 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bc95bbd6-f637-4f66-9130-2b6bce8eebef tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:31.753949 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=4 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:31.762963 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.objects.instance [None req-bc95bbd6-f637-4f66-9130-2b6bce8eebef tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lazy-loading 'flavor' on Instance uuid b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c {{(pid=117739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:23:31.897507 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-bc95bbd6-f637-4f66-9130-2b6bce8eebef tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "POST /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c/action" status: 200 len: 32 microversion: 2.1 time: 0.182325 Jul 27 04:23:31.898465 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 99/210] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:23:31 2022] POST /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 04:23:31.908665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0b1a3975-24b5-482a-a8fb-692a6c4840bc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:31.909345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0b1a3975-24b5-482a-a8fb-692a6c4840bc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:31.915493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0b1a3975-24b5-482a-a8fb-692a6c4840bc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:31.915937 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0b1a3975-24b5-482a-a8fb-692a6c4840bc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:31.916688 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0b1a3975-24b5-482a-a8fb-692a6c4840bc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:31.917246 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0b1a3975-24b5-482a-a8fb-692a6c4840bc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:32.057693 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0b1a3975-24b5-482a-a8fb-692a6c4840bc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:32.059288 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-a039da61-6935-44f1-9c99-aea7c8138da6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:32.059994 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-a039da61-6935-44f1-9c99-aea7c8138da6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:32.062944 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=18 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:32.065472 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0b1a3975-24b5-482a-a8fb-692a6c4840bc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.160716 Jul 27 04:23:32.066168 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 112/211] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:31 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:32.068027 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a039da61-6935-44f1-9c99-aea7c8138da6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:32.068523 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a039da61-6935-44f1-9c99-aea7c8138da6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:32.069288 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a039da61-6935-44f1-9c99-aea7c8138da6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:32.069712 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a039da61-6935-44f1-9c99-aea7c8138da6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:32.204048 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-a039da61-6935-44f1-9c99-aea7c8138da6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:32.211526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-a039da61-6935-44f1-9c99-aea7c8138da6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.156557 Jul 27 04:23:32.212147 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 100/212] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:32 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:23:32.379834 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e3ee6af6-8eb0-4b10-a73a-015799bc6086 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:32.380453 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e3ee6af6-8eb0-4b10-a73a-015799bc6086 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:32.388752 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e3ee6af6-8eb0-4b10-a73a-015799bc6086 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:32.389211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e3ee6af6-8eb0-4b10-a73a-015799bc6086 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:32.390373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e3ee6af6-8eb0-4b10-a73a-015799bc6086 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:32.390863 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e3ee6af6-8eb0-4b10-a73a-015799bc6086 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:32.395209 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=100 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:32.579041 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e3ee6af6-8eb0-4b10-a73a-015799bc6086 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:32.586854 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e3ee6af6-8eb0-4b10-a73a-015799bc6086 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:32.588525 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e3ee6af6-8eb0-4b10-a73a-015799bc6086 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:32.589628 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e3ee6af6-8eb0-4b10-a73a-015799bc6086 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1407 microversion: 2.20 time: 0.215107 Jul 27 04:23:32.590215 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 113/213] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:32 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:33.087788 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-37c046dc-c1d7-4755-a48a-def69ca5858c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:33.088481 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-37c046dc-c1d7-4755-a48a-def69ca5858c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:33.094921 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-37c046dc-c1d7-4755-a48a-def69ca5858c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:33.095459 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-37c046dc-c1d7-4755-a48a-def69ca5858c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:33.096400 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-37c046dc-c1d7-4755-a48a-def69ca5858c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:33.096903 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-37c046dc-c1d7-4755-a48a-def69ca5858c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:33.233358 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-de26056c-9268-4175-9f40-0bc5679d0818 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:33.233958 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-de26056c-9268-4175-9f40-0bc5679d0818 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:33.240067 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-de26056c-9268-4175-9f40-0bc5679d0818 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:33.240513 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-de26056c-9268-4175-9f40-0bc5679d0818 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:33.241281 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-de26056c-9268-4175-9f40-0bc5679d0818 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:33.241715 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-de26056c-9268-4175-9f40-0bc5679d0818 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:33.378324 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-37c046dc-c1d7-4755-a48a-def69ca5858c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:33.385869 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-37c046dc-c1d7-4755-a48a-def69ca5858c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.302034 Jul 27 04:23:33.386466 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 101/214] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:33 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:33.430950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-de26056c-9268-4175-9f40-0bc5679d0818 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:33.439175 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-de26056c-9268-4175-9f40-0bc5679d0818 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.209667 Jul 27 04:23:33.439756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 114/215] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:33 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:23:33.613288 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-06bb28f1-d9b2-4e52-871d-b04e3e3bff3a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:33.613926 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-06bb28f1-d9b2-4e52-871d-b04e3e3bff3a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:33.620057 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-06bb28f1-d9b2-4e52-871d-b04e3e3bff3a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:33.620493 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-06bb28f1-d9b2-4e52-871d-b04e3e3bff3a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:33.621244 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-06bb28f1-d9b2-4e52-871d-b04e3e3bff3a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:33.621664 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-06bb28f1-d9b2-4e52-871d-b04e3e3bff3a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:33.783768 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-06bb28f1-d9b2-4e52-871d-b04e3e3bff3a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:33.792469 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-06bb28f1-d9b2-4e52-871d-b04e3e3bff3a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:33.793926 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-06bb28f1-d9b2-4e52-871d-b04e3e3bff3a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:33.795047 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-06bb28f1-d9b2-4e52-871d-b04e3e3bff3a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1407 microversion: 2.20 time: 0.185652 Jul 27 04:23:33.795709 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 102/216] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:33 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:34.407755 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-6b3092d1-8d2f-4179-a90e-0f7b28a3d407 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:34.408373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-6b3092d1-8d2f-4179-a90e-0f7b28a3d407 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:34.414922 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6b3092d1-8d2f-4179-a90e-0f7b28a3d407 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:34.415368 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6b3092d1-8d2f-4179-a90e-0f7b28a3d407 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:34.416253 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6b3092d1-8d2f-4179-a90e-0f7b28a3d407 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:34.416684 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6b3092d1-8d2f-4179-a90e-0f7b28a3d407 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:34.459803 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c1a76173-2728-4b7e-bbfd-5372dbbc7c65 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:34.460441 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c1a76173-2728-4b7e-bbfd-5372dbbc7c65 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:34.472520 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c1a76173-2728-4b7e-bbfd-5372dbbc7c65 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:34.472956 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c1a76173-2728-4b7e-bbfd-5372dbbc7c65 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:34.473718 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c1a76173-2728-4b7e-bbfd-5372dbbc7c65 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:34.474177 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c1a76173-2728-4b7e-bbfd-5372dbbc7c65 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:34.570630 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-6b3092d1-8d2f-4179-a90e-0f7b28a3d407 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:34.581193 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-6b3092d1-8d2f-4179-a90e-0f7b28a3d407 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.177132 Jul 27 04:23:34.581883 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 115/217] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:34 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:34.649116 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c1a76173-2728-4b7e-bbfd-5372dbbc7c65 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:34.657188 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c1a76173-2728-4b7e-bbfd-5372dbbc7c65 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1319 microversion: 2.1 time: 0.201119 Jul 27 04:23:34.657755 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 103/218] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:34 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:23:34.817198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b424f8ac-ae69-47bb-abdc-7f333f68e708 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:34.817875 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b424f8ac-ae69-47bb-abdc-7f333f68e708 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:34.827830 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b424f8ac-ae69-47bb-abdc-7f333f68e708 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:34.828274 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b424f8ac-ae69-47bb-abdc-7f333f68e708 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:34.829060 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b424f8ac-ae69-47bb-abdc-7f333f68e708 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:34.829497 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b424f8ac-ae69-47bb-abdc-7f333f68e708 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:35.040484 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b424f8ac-ae69-47bb-abdc-7f333f68e708 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:35.051809 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b424f8ac-ae69-47bb-abdc-7f333f68e708 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:35.053689 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b424f8ac-ae69-47bb-abdc-7f333f68e708 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:35.055022 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b424f8ac-ae69-47bb-abdc-7f333f68e708 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1407 microversion: 2.20 time: 0.241788 Jul 27 04:23:35.055668 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 116/219] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:34 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:23:35.612862 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d9948630-965f-4373-bd70-7c8fe4bf723d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:35.614806 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d9948630-965f-4373-bd70-7c8fe4bf723d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:35.621413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d9948630-965f-4373-bd70-7c8fe4bf723d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:35.622076 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d9948630-965f-4373-bd70-7c8fe4bf723d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:35.623007 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d9948630-965f-4373-bd70-7c8fe4bf723d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:35.623433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d9948630-965f-4373-bd70-7c8fe4bf723d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:35.678491 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-2c8f8697-5bb3-463b-862c-9900cedc2506 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:35.679661 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-2c8f8697-5bb3-463b-862c-9900cedc2506 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:35.686478 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2c8f8697-5bb3-463b-862c-9900cedc2506 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:35.687091 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2c8f8697-5bb3-463b-862c-9900cedc2506 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:35.688170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2c8f8697-5bb3-463b-862c-9900cedc2506 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:35.688774 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2c8f8697-5bb3-463b-862c-9900cedc2506 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:35.806076 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d9948630-965f-4373-bd70-7c8fe4bf723d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:35.831378 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d9948630-965f-4373-bd70-7c8fe4bf723d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.230882 Jul 27 04:23:35.846892 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 104/220] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:35 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:35.963988 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-2c8f8697-5bb3-463b-862c-9900cedc2506 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:35.975426 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-2c8f8697-5bb3-463b-862c-9900cedc2506 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1507 microversion: 2.1 time: 0.300682 Jul 27 04:23:35.991486 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 117/221] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:35 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:36.083518 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-27935aa1-41a6-4796-b2ac-b53d92218938 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:36.084286 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-27935aa1-41a6-4796-b2ac-b53d92218938 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:36.091273 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-27935aa1-41a6-4796-b2ac-b53d92218938 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:36.091713 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-27935aa1-41a6-4796-b2ac-b53d92218938 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:36.092690 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-27935aa1-41a6-4796-b2ac-b53d92218938 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:36.093123 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-27935aa1-41a6-4796-b2ac-b53d92218938 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:36.246732 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-27935aa1-41a6-4796-b2ac-b53d92218938 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:36.254948 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-27935aa1-41a6-4796-b2ac-b53d92218938 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:36.256813 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-27935aa1-41a6-4796-b2ac-b53d92218938 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:36.258141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-27935aa1-41a6-4796-b2ac-b53d92218938 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1407 microversion: 2.20 time: 0.181236 Jul 27 04:23:36.258682 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 105/222] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:36 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:36.852404 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-de60b3d3-c4fb-4be3-96d7-0de7efe74aab tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:36.853020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-de60b3d3-c4fb-4be3-96d7-0de7efe74aab tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:36.859620 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-de60b3d3-c4fb-4be3-96d7-0de7efe74aab tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:36.860066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-de60b3d3-c4fb-4be3-96d7-0de7efe74aab tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:36.860871 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-de60b3d3-c4fb-4be3-96d7-0de7efe74aab tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:36.861304 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-de60b3d3-c4fb-4be3-96d7-0de7efe74aab tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:36.962620 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-c18c3dab-82c9-4594-9101-a5e9d7043d89 req-fb20cb99-ac61-403e-96ff-f464ee7b99c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9478c2cb-a66c-4485-91bf-fe8486025afe", "name": "network-vif-plugged", "status": "completed", "tag": "d905ab8e-bb09-45aa-9436-9f67042c2d1a"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:23:36.978873 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-c18c3dab-82c9-4594-9101-a5e9d7043d89 req-fb20cb99-ac61-403e-96ff-f464ee7b99c9 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:36.979788 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-c18c3dab-82c9-4594-9101-a5e9d7043d89 req-fb20cb99-ac61-403e-96ff-f464ee7b99c9 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:36.998209 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-c18c3dab-82c9-4594-9101-a5e9d7043d89 req-fb20cb99-ac61-403e-96ff-f464ee7b99c9 service nova] Creating event network-vif-plugged:d905ab8e-bb09-45aa-9436-9f67042c2d1a for instance 9478c2cb-a66c-4485-91bf-fe8486025afe on hv-cinder-85098 Jul 27 04:23:36.998550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-c18c3dab-82c9-4594-9101-a5e9d7043d89 req-fb20cb99-ac61-403e-96ff-f464ee7b99c9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041009 Jul 27 04:23:37.000533 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 106/223] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:23:37.010973 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-de60b3d3-c4fb-4be3-96d7-0de7efe74aab tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:37.021072 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-de60b3d3-c4fb-4be3-96d7-0de7efe74aab tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.172412 Jul 27 04:23:37.036203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 118/224] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:36 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:23:37.285369 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-1b4e81fb-c593-4bda-a738-10de19420c65 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:37.286215 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-1b4e81fb-c593-4bda-a738-10de19420c65 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:37.293539 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1b4e81fb-c593-4bda-a738-10de19420c65 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:37.294523 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1b4e81fb-c593-4bda-a738-10de19420c65 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:37.295308 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1b4e81fb-c593-4bda-a738-10de19420c65 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:37.295748 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1b4e81fb-c593-4bda-a738-10de19420c65 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:37.439254 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-1b4e81fb-c593-4bda-a738-10de19420c65 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:37.454402 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-1b4e81fb-c593-4bda-a738-10de19420c65 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:37.456159 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-1b4e81fb-c593-4bda-a738-10de19420c65 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:37.457397 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-1b4e81fb-c593-4bda-a738-10de19420c65 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1407 microversion: 2.20 time: 0.176327 Jul 27 04:23:37.457941 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 107/225] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:37 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:38.043111 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4093b42e-f979-4c84-95e7-2b3b4839005f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:38.043742 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4093b42e-f979-4c84-95e7-2b3b4839005f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:38.050062 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4093b42e-f979-4c84-95e7-2b3b4839005f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:38.050463 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4093b42e-f979-4c84-95e7-2b3b4839005f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:38.051218 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4093b42e-f979-4c84-95e7-2b3b4839005f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:38.051645 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4093b42e-f979-4c84-95e7-2b3b4839005f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:38.200417 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4093b42e-f979-4c84-95e7-2b3b4839005f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:38.208152 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4093b42e-f979-4c84-95e7-2b3b4839005f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.169368 Jul 27 04:23:38.208729 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 119/226] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:38 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:38.484744 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-81eee10b-5b9d-4aa6-b784-92bd8f475f14 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:38.486268 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-81eee10b-5b9d-4aa6-b784-92bd8f475f14 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:38.493282 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-81eee10b-5b9d-4aa6-b784-92bd8f475f14 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:38.494031 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-81eee10b-5b9d-4aa6-b784-92bd8f475f14 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:38.494793 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-81eee10b-5b9d-4aa6-b784-92bd8f475f14 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:38.495226 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-81eee10b-5b9d-4aa6-b784-92bd8f475f14 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:38.646996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-81eee10b-5b9d-4aa6-b784-92bd8f475f14 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:38.655739 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-81eee10b-5b9d-4aa6-b784-92bd8f475f14 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:38.657330 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-81eee10b-5b9d-4aa6-b784-92bd8f475f14 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:38.658545 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-81eee10b-5b9d-4aa6-b784-92bd8f475f14 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1407 microversion: 2.20 time: 0.180308 Jul 27 04:23:38.659214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 108/227] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:38 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:39.229810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-01535ce6-8356-4eca-9398-c849a2b36aee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:39.230448 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-01535ce6-8356-4eca-9398-c849a2b36aee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:39.236781 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-01535ce6-8356-4eca-9398-c849a2b36aee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:39.237221 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-01535ce6-8356-4eca-9398-c849a2b36aee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:39.237992 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-01535ce6-8356-4eca-9398-c849a2b36aee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:39.238429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-01535ce6-8356-4eca-9398-c849a2b36aee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:39.373821 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-01535ce6-8356-4eca-9398-c849a2b36aee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:39.381997 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-01535ce6-8356-4eca-9398-c849a2b36aee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.155947 Jul 27 04:23:39.395765 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 120/228] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:39 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:39.681438 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d298f6bd-8847-44ce-becb-2c76be11f14d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:39.683071 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d298f6bd-8847-44ce-becb-2c76be11f14d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:39.690151 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d298f6bd-8847-44ce-becb-2c76be11f14d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:39.690810 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d298f6bd-8847-44ce-becb-2c76be11f14d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:39.691718 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d298f6bd-8847-44ce-becb-2c76be11f14d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:39.692283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d298f6bd-8847-44ce-becb-2c76be11f14d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:39.883133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d298f6bd-8847-44ce-becb-2c76be11f14d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:39.892490 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d298f6bd-8847-44ce-becb-2c76be11f14d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:39.894010 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d298f6bd-8847-44ce-becb-2c76be11f14d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:39.895110 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d298f6bd-8847-44ce-becb-2c76be11f14d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1407 microversion: 2.20 time: 0.218495 Jul 27 04:23:39.895683 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 109/229] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:39 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:40.403313 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-74e685d5-4f54-434f-aba2-23e341734ade tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:40.403921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-74e685d5-4f54-434f-aba2-23e341734ade tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:40.410651 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-74e685d5-4f54-434f-aba2-23e341734ade tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:40.411120 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-74e685d5-4f54-434f-aba2-23e341734ade tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:40.411893 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-74e685d5-4f54-434f-aba2-23e341734ade tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:40.412350 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-74e685d5-4f54-434f-aba2-23e341734ade tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:40.559966 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-74e685d5-4f54-434f-aba2-23e341734ade tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:40.574099 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-74e685d5-4f54-434f-aba2-23e341734ade tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.175265 Jul 27 04:23:40.575011 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 121/230] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:40 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:40.918782 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4e9d6ca3-18fb-4f54-80e9-c9c524417ae8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:40.920097 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4e9d6ca3-18fb-4f54-80e9-c9c524417ae8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:40.927352 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e9d6ca3-18fb-4f54-80e9-c9c524417ae8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:40.928050 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e9d6ca3-18fb-4f54-80e9-c9c524417ae8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:40.929053 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e9d6ca3-18fb-4f54-80e9-c9c524417ae8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:40.929862 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e9d6ca3-18fb-4f54-80e9-c9c524417ae8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:41.067302 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4e9d6ca3-18fb-4f54-80e9-c9c524417ae8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:41.076417 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4e9d6ca3-18fb-4f54-80e9-c9c524417ae8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:41.077913 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4e9d6ca3-18fb-4f54-80e9-c9c524417ae8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:41.079039 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4e9d6ca3-18fb-4f54-80e9-c9c524417ae8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1407 microversion: 2.20 time: 0.164799 Jul 27 04:23:41.079599 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 110/231] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:40 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:41.596799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3f5c284c-ce7d-44f7-85e2-30f011e909e2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:41.597442 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3f5c284c-ce7d-44f7-85e2-30f011e909e2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:41.604519 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f5c284c-ce7d-44f7-85e2-30f011e909e2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:41.605023 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f5c284c-ce7d-44f7-85e2-30f011e909e2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:41.605797 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f5c284c-ce7d-44f7-85e2-30f011e909e2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:41.606259 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f5c284c-ce7d-44f7-85e2-30f011e909e2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:41.747335 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3f5c284c-ce7d-44f7-85e2-30f011e909e2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:41.755427 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3f5c284c-ce7d-44f7-85e2-30f011e909e2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.162519 Jul 27 04:23:41.755996 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 122/232] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:41 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:42.102469 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b18588b6-8d06-413f-a1f8-9eb1d492a84d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:42.103111 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-b18588b6-8d06-413f-a1f8-9eb1d492a84d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:42.109899 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b18588b6-8d06-413f-a1f8-9eb1d492a84d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:42.110385 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b18588b6-8d06-413f-a1f8-9eb1d492a84d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:42.111138 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b18588b6-8d06-413f-a1f8-9eb1d492a84d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:42.111571 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b18588b6-8d06-413f-a1f8-9eb1d492a84d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:42.115726 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:42.258056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-b18588b6-8d06-413f-a1f8-9eb1d492a84d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:42.267430 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-b18588b6-8d06-413f-a1f8-9eb1d492a84d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:42.269312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-b18588b6-8d06-413f-a1f8-9eb1d492a84d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:42.270670 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-b18588b6-8d06-413f-a1f8-9eb1d492a84d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1599 microversion: 2.20 time: 0.172143 Jul 27 04:23:42.279318 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 111/233] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:23:42 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1599 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:23:42.301926 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ce5da03f-e171-41d3-99b5-c4d46dcb7219 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:42.302548 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ce5da03f-e171-41d3-99b5-c4d46dcb7219 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:42.309378 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ce5da03f-e171-41d3-99b5-c4d46dcb7219 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:42.309899 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ce5da03f-e171-41d3-99b5-c4d46dcb7219 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:42.310770 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ce5da03f-e171-41d3-99b5-c4d46dcb7219 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:42.311265 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ce5da03f-e171-41d3-99b5-c4d46dcb7219 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:42.399464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ce5da03f-e171-41d3-99b5-c4d46dcb7219 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101179 Jul 27 04:23:42.400099 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 123/234] 10.222.0.46 () {60 vars in 1316 bytes} [Wed Jul 27 04:23:42 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 04:23:42.778867 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-618c4d51-a150-4951-9253-34d57da9e572 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:42.780270 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-618c4d51-a150-4951-9253-34d57da9e572 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:42.787342 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-618c4d51-a150-4951-9253-34d57da9e572 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:42.787793 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-618c4d51-a150-4951-9253-34d57da9e572 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:42.788581 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-618c4d51-a150-4951-9253-34d57da9e572 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:42.797391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-618c4d51-a150-4951-9253-34d57da9e572 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:43.019754 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-618c4d51-a150-4951-9253-34d57da9e572 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:43.035504 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-618c4d51-a150-4951-9253-34d57da9e572 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.260975 Jul 27 04:23:43.052334 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 112/235] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:42 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:44.060980 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-7be8cf32-c292-4cd6-9f04-e40dfc4735a8 req-5879814d-3a98-4b6d-bba9-876d22a65fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9478c2cb-a66c-4485-91bf-fe8486025afe", "tag": "d905ab8e-bb09-45aa-9436-9f67042c2d1a"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:23:44.062237 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3d774cc7-a752-4bac-aeed-e2bbef1b1744 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:44.063540 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3d774cc7-a752-4bac-aeed-e2bbef1b1744 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:44.071064 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3d774cc7-a752-4bac-aeed-e2bbef1b1744 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:44.072325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3d774cc7-a752-4bac-aeed-e2bbef1b1744 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:44.073824 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3d774cc7-a752-4bac-aeed-e2bbef1b1744 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:44.074603 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3d774cc7-a752-4bac-aeed-e2bbef1b1744 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:44.076550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-7be8cf32-c292-4cd6-9f04-e40dfc4735a8 req-5879814d-3a98-4b6d-bba9-876d22a65fd4 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:44.076985 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-7be8cf32-c292-4cd6-9f04-e40dfc4735a8 req-5879814d-3a98-4b6d-bba9-876d22a65fd4 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:44.094589 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-7be8cf32-c292-4cd6-9f04-e40dfc4735a8 req-5879814d-3a98-4b6d-bba9-876d22a65fd4 service nova] Creating event network-changed:d905ab8e-bb09-45aa-9436-9f67042c2d1a for instance 9478c2cb-a66c-4485-91bf-fe8486025afe on hv-cinder-85098 Jul 27 04:23:44.107294 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-7be8cf32-c292-4cd6-9f04-e40dfc4735a8 req-5879814d-3a98-4b6d-bba9-876d22a65fd4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051906 Jul 27 04:23:44.107908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 113/236] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:23:44.392324 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3d774cc7-a752-4bac-aeed-e2bbef1b1744 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:44.407992 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3d774cc7-a752-4bac-aeed-e2bbef1b1744 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.352969 Jul 27 04:23:44.410275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 124/237] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:44 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:45.432810 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-11f7584a-1c3b-4d2c-b75c-f183bb7d713a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:45.433514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-11f7584a-1c3b-4d2c-b75c-f183bb7d713a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:45.439877 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-11f7584a-1c3b-4d2c-b75c-f183bb7d713a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:45.440317 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-11f7584a-1c3b-4d2c-b75c-f183bb7d713a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:45.441066 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-11f7584a-1c3b-4d2c-b75c-f183bb7d713a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:45.441501 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-11f7584a-1c3b-4d2c-b75c-f183bb7d713a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:45.663641 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-11f7584a-1c3b-4d2c-b75c-f183bb7d713a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:45.674367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-11f7584a-1c3b-4d2c-b75c-f183bb7d713a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.245979 Jul 27 04:23:45.675500 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 114/238] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:45 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:46.707713 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-18bc1f46-51d1-4be4-b0ec-31fd9f0d4796 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:46.709900 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-18bc1f46-51d1-4be4-b0ec-31fd9f0d4796 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:46.738112 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18bc1f46-51d1-4be4-b0ec-31fd9f0d4796 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:46.738563 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18bc1f46-51d1-4be4-b0ec-31fd9f0d4796 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:46.741819 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18bc1f46-51d1-4be4-b0ec-31fd9f0d4796 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:46.743615 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18bc1f46-51d1-4be4-b0ec-31fd9f0d4796 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:47.081063 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-18bc1f46-51d1-4be4-b0ec-31fd9f0d4796 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:47.088979 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-18bc1f46-51d1-4be4-b0ec-31fd9f0d4796 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.395926 Jul 27 04:23:47.089551 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 125/239] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:46 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:48.112409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c5a37b35-d61b-4d8b-8ac4-fbec8a366d1c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:48.113065 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c5a37b35-d61b-4d8b-8ac4-fbec8a366d1c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:48.121197 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c5a37b35-d61b-4d8b-8ac4-fbec8a366d1c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:48.121926 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c5a37b35-d61b-4d8b-8ac4-fbec8a366d1c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:48.122994 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c5a37b35-d61b-4d8b-8ac4-fbec8a366d1c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:48.123811 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c5a37b35-d61b-4d8b-8ac4-fbec8a366d1c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:48.289358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c5a37b35-d61b-4d8b-8ac4-fbec8a366d1c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:48.297923 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c5a37b35-d61b-4d8b-8ac4-fbec8a366d1c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.190565 Jul 27 04:23:48.298531 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 115/240] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:48 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:49.320362 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d96b5e37-bb9c-4d5f-883b-1d8a9e610d90 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:49.321269 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d96b5e37-bb9c-4d5f-883b-1d8a9e610d90 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:49.324369 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=62 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:49.329575 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d96b5e37-bb9c-4d5f-883b-1d8a9e610d90 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:49.330052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d96b5e37-bb9c-4d5f-883b-1d8a9e610d90 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:49.333727 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d96b5e37-bb9c-4d5f-883b-1d8a9e610d90 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:49.334199 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d96b5e37-bb9c-4d5f-883b-1d8a9e610d90 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:49.472825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d96b5e37-bb9c-4d5f-883b-1d8a9e610d90 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:49.481100 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d96b5e37-bb9c-4d5f-883b-1d8a9e610d90 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.164863 Jul 27 04:23:49.481658 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 126/241] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:49 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:23:50.502592 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d9eec7cd-6722-4d48-9483-af7406882b2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:50.503866 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d9eec7cd-6722-4d48-9483-af7406882b2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:50.505888 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:50.511419 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d9eec7cd-6722-4d48-9483-af7406882b2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:50.512000 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d9eec7cd-6722-4d48-9483-af7406882b2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:50.512760 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d9eec7cd-6722-4d48-9483-af7406882b2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:50.513189 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d9eec7cd-6722-4d48-9483-af7406882b2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:50.684143 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d9eec7cd-6722-4d48-9483-af7406882b2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:50.693675 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d9eec7cd-6722-4d48-9483-af7406882b2b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.194940 Jul 27 04:23:50.694284 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 116/242] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:50 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:23:51.719009 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-77ecc3ac-fe83-4bfe-8c63-e30999dd4d4b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:51.720219 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-77ecc3ac-fe83-4bfe-8c63-e30999dd4d4b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:51.726684 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-77ecc3ac-fe83-4bfe-8c63-e30999dd4d4b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:51.727133 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-77ecc3ac-fe83-4bfe-8c63-e30999dd4d4b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:51.728081 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-77ecc3ac-fe83-4bfe-8c63-e30999dd4d4b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:51.729433 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-77ecc3ac-fe83-4bfe-8c63-e30999dd4d4b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:51.887891 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-77ecc3ac-fe83-4bfe-8c63-e30999dd4d4b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:51.895542 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-77ecc3ac-fe83-4bfe-8c63-e30999dd4d4b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.180379 Jul 27 04:23:51.910074 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 127/243] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:51 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:52.917550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4aa3485c-93d0-4fa6-9755-a94699223b29 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:52.918925 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4aa3485c-93d0-4fa6-9755-a94699223b29 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:52.926878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4aa3485c-93d0-4fa6-9755-a94699223b29 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:52.928090 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4aa3485c-93d0-4fa6-9755-a94699223b29 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:52.929182 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4aa3485c-93d0-4fa6-9755-a94699223b29 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:52.929906 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4aa3485c-93d0-4fa6-9755-a94699223b29 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:53.347493 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4aa3485c-93d0-4fa6-9755-a94699223b29 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:53.355726 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4aa3485c-93d0-4fa6-9755-a94699223b29 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.442880 Jul 27 04:23:53.357159 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 117/244] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:52 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:54.376894 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0978b532-ff36-4770-8995-989fdc694666 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:54.377505 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0978b532-ff36-4770-8995-989fdc694666 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:54.383799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0978b532-ff36-4770-8995-989fdc694666 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:54.384238 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0978b532-ff36-4770-8995-989fdc694666 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:54.385792 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0978b532-ff36-4770-8995-989fdc694666 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:54.386500 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0978b532-ff36-4770-8995-989fdc694666 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:54.637573 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0978b532-ff36-4770-8995-989fdc694666 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:54.645589 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0978b532-ff36-4770-8995-989fdc694666 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.272388 Jul 27 04:23:54.650987 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 128/245] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:54 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:55.677116 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ebe396ca-14d9-4d81-a7e1-6e8c90cec1f1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:55.677756 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ebe396ca-14d9-4d81-a7e1-6e8c90cec1f1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:55.689685 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ebe396ca-14d9-4d81-a7e1-6e8c90cec1f1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:55.690175 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ebe396ca-14d9-4d81-a7e1-6e8c90cec1f1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:55.695382 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ebe396ca-14d9-4d81-a7e1-6e8c90cec1f1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:55.695836 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ebe396ca-14d9-4d81-a7e1-6e8c90cec1f1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:56.062595 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ebe396ca-14d9-4d81-a7e1-6e8c90cec1f1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:56.079574 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ebe396ca-14d9-4d81-a7e1-6e8c90cec1f1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.408303 Jul 27 04:23:56.080222 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 118/246] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:55 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:57.121383 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-220e7a35-5cdf-4a7c-9ac6-d119d18ea349 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:57.121941 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-220e7a35-5cdf-4a7c-9ac6-d119d18ea349 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:57.132217 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-220e7a35-5cdf-4a7c-9ac6-d119d18ea349 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:57.133470 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-220e7a35-5cdf-4a7c-9ac6-d119d18ea349 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:57.136488 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-220e7a35-5cdf-4a7c-9ac6-d119d18ea349 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:57.137258 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-220e7a35-5cdf-4a7c-9ac6-d119d18ea349 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:57.473111 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-220e7a35-5cdf-4a7c-9ac6-d119d18ea349 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:57.483356 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-220e7a35-5cdf-4a7c-9ac6-d119d18ea349 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.368714 Jul 27 04:23:57.484946 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 129/247] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:57 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:23:58.505404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c020bc0c-d77a-45ad-8576-4370a563fc10 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:23:58.506611 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c020bc0c-d77a-45ad-8576-4370a563fc10 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:23:58.522205 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c020bc0c-d77a-45ad-8576-4370a563fc10 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:58.523614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c020bc0c-d77a-45ad-8576-4370a563fc10 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:58.528443 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c020bc0c-d77a-45ad-8576-4370a563fc10 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:23:58.529099 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c020bc0c-d77a-45ad-8576-4370a563fc10 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:23:59.107347 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c020bc0c-d77a-45ad-8576-4370a563fc10 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:23:59.117810 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c020bc0c-d77a-45ad-8576-4370a563fc10 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.616177 Jul 27 04:23:59.118401 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 119/248] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:23:58 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:00.143993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0cae055e-58e0-4e67-8942-67276850f9a1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:00.144784 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0cae055e-58e0-4e67-8942-67276850f9a1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:00.159734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0cae055e-58e0-4e67-8942-67276850f9a1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:00.160195 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0cae055e-58e0-4e67-8942-67276850f9a1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:00.161010 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0cae055e-58e0-4e67-8942-67276850f9a1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:00.162138 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0cae055e-58e0-4e67-8942-67276850f9a1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:00.221699 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=100 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:00.553828 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0cae055e-58e0-4e67-8942-67276850f9a1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:00.571631 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0cae055e-58e0-4e67-8942-67276850f9a1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.431920 Jul 27 04:24:00.586002 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 130/249] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:00 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:01.603640 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e13c1fc5-7e7e-4100-b860-efb8fde144c5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:01.604425 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e13c1fc5-7e7e-4100-b860-efb8fde144c5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:01.611508 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e13c1fc5-7e7e-4100-b860-efb8fde144c5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:01.612441 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e13c1fc5-7e7e-4100-b860-efb8fde144c5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:01.613935 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e13c1fc5-7e7e-4100-b860-efb8fde144c5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:01.615167 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e13c1fc5-7e7e-4100-b860-efb8fde144c5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:02.238171 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e13c1fc5-7e7e-4100-b860-efb8fde144c5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:02.254419 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e13c1fc5-7e7e-4100-b860-efb8fde144c5 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.655053 Jul 27 04:24:02.262535 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 120/250] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:01 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:03.283347 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-221afa42-48f0-42b5-b3cf-9f7101bfa5d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:03.283986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-221afa42-48f0-42b5-b3cf-9f7101bfa5d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:03.303407 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-221afa42-48f0-42b5-b3cf-9f7101bfa5d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:03.303769 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-221afa42-48f0-42b5-b3cf-9f7101bfa5d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:03.304619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-221afa42-48f0-42b5-b3cf-9f7101bfa5d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:03.305120 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-221afa42-48f0-42b5-b3cf-9f7101bfa5d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:03.657951 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-221afa42-48f0-42b5-b3cf-9f7101bfa5d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:03.675835 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-221afa42-48f0-42b5-b3cf-9f7101bfa5d3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1502 microversion: 2.1 time: 0.396528 Jul 27 04:24:03.677107 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 131/251] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:03 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1502 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:03.705062 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-10f8548c-bfcc-49aa-b090-63ebe4fad285 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffeb60ba-6ded-4fef-84fe-013f229afd9c"}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:03.708231 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-10f8548c-bfcc-49aa-b090-63ebe4fad285 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:03.739969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-10f8548c-bfcc-49aa-b090-63ebe4fad285 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:03.740432 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-10f8548c-bfcc-49aa-b090-63ebe4fad285 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:03.741313 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-10f8548c-bfcc-49aa-b090-63ebe4fad285 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:03.742136 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-10f8548c-bfcc-49aa-b090-63ebe4fad285 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:03.799853 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-10f8548c-bfcc-49aa-b090-63ebe4fad285 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] HTTP exception thrown: Cannot 'attach_volume' instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c while it is in vm_state rescued Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-10f8548c-bfcc-49aa-b090-63ebe4fad285 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Request method failure captured: Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: POST /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c/os-volume_attachments HTTP/1.1 Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 74 Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L1Z-GzUdIE10GBth8M9cTTXAKFLlAQub-RLT6WXeUQ2VTjpVcQi9ERrlBs4sOixL-py8Kq_jHt_mJTkFcFxZ2U68zJZmnqGbGiZAMMZ4GJmWWXTF0LUNVT9PhKk7EpB-gN290q8fAEZkyrjCK6yf2Eia0XZsajg3TgawFCUPD4ekpI Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: 5bb7f3d2bc1e4651b7f1e0ac6debd89a Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:24:03.802437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:24:03.804067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:24:03.804067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:24:03.804067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: 5bb7f3d2bc1e4651b7f1e0ac6debd89a Jul 27 04:24:03.804067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:24:03.804067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-ServerRescueNegativeTestJSON-708246425-project Jul 27 04:24:03.804067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:24:03.804067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:24:03.804067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 5a69202d87094049b12765d64c17e515 Jul 27 04:24:03.804067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-ServerRescueNegativeTestJSON-708246425-project Jul 27 04:24:03.804067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Jul 27 04:24:03.804067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {"volumeAttachment": {"volumeId": "ffeb60ba-6ded-4fef-84fe-013f229afd9c"}} Jul 27 04:24:03.804067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Cannot 'attach_volume' instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c while it is in vm_state rescued Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'server_id': 'b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c', 'body': {'volumeAttachment': {'volumeId': 'ffeb60ba-6ded-4fef-84fe-013f229afd9c'}}} Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:24:03.804957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c while it is in vm_state rescued Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:24:03.806989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:24:03.808448 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:24:03.808448 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:24:03.808448 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c while it is in vm_state rescued Jul 27 04:24:03.808448 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:24:03.810100 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-10f8548c-bfcc-49aa-b090-63ebe4fad285 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Returning 409 to user: Cannot 'attach_volume' instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c while it is in vm_state rescued {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:24:03.811131 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-10f8548c-bfcc-49aa-b090-63ebe4fad285 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "POST /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.112360 Jul 27 04:24:03.818103 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 121/252] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:24:03 2022] POST /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c/os-volume_attachments => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 27 04:24:03.821166 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f1874514-0fec-4db0-a037-0294f19d4242 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:03.822366 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f1874514-0fec-4db0-a037-0294f19d4242 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:03.832842 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f1874514-0fec-4db0-a037-0294f19d4242 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:03.835659 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f1874514-0fec-4db0-a037-0294f19d4242 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:03.839972 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f1874514-0fec-4db0-a037-0294f19d4242 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:03.840683 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f1874514-0fec-4db0-a037-0294f19d4242 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:03.994464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f1874514-0fec-4db0-a037-0294f19d4242 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "POST /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c/action" status: 202 len: 0 microversion: 2.1 time: 0.177404 Jul 27 04:24:03.995425 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 132/253] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:24:03 2022] POST /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 04:24:04.004099 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-013c63b8-cbdd-4d5e-a736-2b7ad6a619ac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:04.004914 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-013c63b8-cbdd-4d5e-a736-2b7ad6a619ac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:04.015979 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-013c63b8-cbdd-4d5e-a736-2b7ad6a619ac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:04.016676 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-013c63b8-cbdd-4d5e-a736-2b7ad6a619ac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:04.017665 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-013c63b8-cbdd-4d5e-a736-2b7ad6a619ac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:04.018629 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-013c63b8-cbdd-4d5e-a736-2b7ad6a619ac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:04.376671 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-013c63b8-cbdd-4d5e-a736-2b7ad6a619ac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:04.390546 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-013c63b8-cbdd-4d5e-a736-2b7ad6a619ac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1510 microversion: 2.1 time: 0.390592 Jul 27 04:24:04.392592 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 122/254] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:03 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:05.049105 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9b4ac673-d649-4cea-b26f-ae6dece696b4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e135d3da-4204-450f-b7c3-2867b1570807", "device": "/dev/sdb"}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:05.055925 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-9b4ac673-d649-4cea-b26f-ae6dece696b4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:05.077722 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9b4ac673-d649-4cea-b26f-ae6dece696b4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:05.078661 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9b4ac673-d649-4cea-b26f-ae6dece696b4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:05.079746 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9b4ac673-d649-4cea-b26f-ae6dece696b4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:05.080444 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9b4ac673-d649-4cea-b26f-ae6dece696b4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:05.426604 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9aa92c30-b6d1-4586-a4da-fb64fc571b61 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:05.427409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9aa92c30-b6d1-4586-a4da-fb64fc571b61 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:05.445851 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9aa92c30-b6d1-4586-a4da-fb64fc571b61 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:05.446730 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9aa92c30-b6d1-4586-a4da-fb64fc571b61 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:05.449060 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9aa92c30-b6d1-4586-a4da-fb64fc571b61 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:05.449766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9aa92c30-b6d1-4586-a4da-fb64fc571b61 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:05.585139 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-9b4ac673-d649-4cea-b26f-ae6dece696b4 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "POST /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.557978 Jul 27 04:24:05.586528 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 133/255] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:24:05 2022] POST /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7/os-volume_attachments => generated 194 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:24:05.891636 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9aa92c30-b6d1-4586-a4da-fb64fc571b61 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:05.916336 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9aa92c30-b6d1-4586-a4da-fb64fc571b61 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1510 microversion: 2.1 time: 0.506339 Jul 27 04:24:05.918067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 123/256] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:05 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1510 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:06.604545 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8839e401-0c24-4463-811a-53b3e1489e25 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Action: 'create', calling method: .version_select at 0x7f21d65318b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-436101483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3tyvVdEqr5E8xlsWwfrsXv82Ev35smd4JnPS+TliBj9njilXKrAUakAB65TcOWiTooWjUyxV8AHNsgRufKzzSYnNi4JhiVvlGVRK05hfwUnq/OqoXfegQ0N+b5Dp9KQA=="}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:06.626969 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-8839e401-0c24-4463-811a-53b3e1489e25 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Getting quotas for project 992437dfa6ef4c678ea5d4f92155cf17. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:24:06.631413 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-8839e401-0c24-4463-811a-53b3e1489e25 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Getting quotas for user 5a7f399240ee4003b0e72fd34d96f47b and project 992437dfa6ef4c678ea5d4f92155cf17. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:24:06.711999 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8839e401-0c24-4463-811a-53b3e1489e25 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.354906 Jul 27 04:24:06.714604 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 134/257] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Jul 27 04:24:06 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:24:06.945717 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0391b35e-5330-4f38-94fa-4dfc1046e625 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:06.946615 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0391b35e-5330-4f38-94fa-4dfc1046e625 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:06.963108 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0391b35e-5330-4f38-94fa-4dfc1046e625 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:06.965569 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0391b35e-5330-4f38-94fa-4dfc1046e625 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:06.966774 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0391b35e-5330-4f38-94fa-4dfc1046e625 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:06.970072 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0391b35e-5330-4f38-94fa-4dfc1046e625 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:07.560768 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-0391b35e-5330-4f38-94fa-4dfc1046e625 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:07.576494 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0391b35e-5330-4f38-94fa-4dfc1046e625 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1510 microversion: 2.1 time: 0.637372 Jul 27 04:24:07.577118 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 124/258] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:06 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1510 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:08.614407 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f62d8e29-f787-4658-b44a-a716e685f774 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:08.615161 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f62d8e29-f787-4658-b44a-a716e685f774 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:08.628322 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f62d8e29-f787-4658-b44a-a716e685f774 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:08.628781 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f62d8e29-f787-4658-b44a-a716e685f774 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:08.629564 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f62d8e29-f787-4658-b44a-a716e685f774 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:08.651073 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f62d8e29-f787-4658-b44a-a716e685f774 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:08.972639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f62d8e29-f787-4658-b44a-a716e685f774 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:08.980861 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f62d8e29-f787-4658-b44a-a716e685f774 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1516 microversion: 2.1 time: 0.373712 Jul 27 04:24:08.988532 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 135/259] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:08 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1516 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:10.959169 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-14e7bd23-f79a-4dbd-b09b-a2076215e145 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Action: 'create', calling method: .version_select at 0x7f21d669a0d0>, body: {"keypair": {"name": "tempest-keypair-1727557744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKgumiZ0aR4WMX77CH4qWH9ew9jwdmbfKcFBc4Nc7N+IU2q+cIxCLTBdr3vt3iX33god1Zc/VW5X+cJ/cirCCtr61D8BDBC5vSm/bT7UIumIpkhwAiRduPKl6QIODyVrQ=="}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:11.023156 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-14e7bd23-f79a-4dbd-b09b-a2076215e145 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Getting quotas for project 5bb7f3d2bc1e4651b7f1e0ac6debd89a. Resources: {'key_pairs'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:24:11.029743 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-14e7bd23-f79a-4dbd-b09b-a2076215e145 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Getting quotas for user 5a69202d87094049b12765d64c17e515 and project 5bb7f3d2bc1e4651b7f1e0ac6debd89a. Resources: {'key_pairs'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:24:11.060087 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-14e7bd23-f79a-4dbd-b09b-a2076215e145 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104575 Jul 27 04:24:11.061948 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 125/260] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Jul 27 04:24:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:24:13.331914 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a83fe507-04dc-4d01-ad06-142ca37beeef tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Action: 'create', calling method: .version_select at 0x7f21d6659160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1427079078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6B5ccksRuY3oYuNd2RrzGlC1zGOSMT2/eOtlHSZAIllRQvS77WkahQ5fHTydVEH5k8MAgzdlRmA6yfNFATvqNPWoRRUIF+8/ttTHi0Or2uPtSdqjgYQi7ygu1awYJ29w=="}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:13.350399 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-a83fe507-04dc-4d01-ad06-142ca37beeef tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Getting quotas for project 3825c2630a4f47e0b029bd0c90875108. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:24:13.354577 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-a83fe507-04dc-4d01-ad06-142ca37beeef tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Getting quotas for user eea5b08eede4409484dc2f4305b5298a and project 3825c2630a4f47e0b029bd0c90875108. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:24:13.379125 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a83fe507-04dc-4d01-ad06-142ca37beeef tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.347848 Jul 27 04:24:13.380508 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 136/261] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Jul 27 04:24:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:24:14.287302 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-872990080", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b6659b1-b144-4a0f-8066-b48287eea6b5"}], "security_groups": [{"name": "tempest-securitygroup--1576339063"}], "key_name": "tempest-keypair-1727557744", "user_data": "}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:14.416969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] validate_networks() for [('9b6659b1-b144-4a0f-8066-b48287eea6b5', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:24:15.153664 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:24:15.154111 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:24:15.154797 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:24:15.155359 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:24:15.155929 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:24:15.173633 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:15.183256 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:15.185963 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:15.187647 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:15.202265 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=77 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:15.229300 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Getting quotas for project 5bb7f3d2bc1e4651b7f1e0ac6debd89a. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:24:15.248347 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Getting quotas for user 5a69202d87094049b12765d64c17e515 and project 5bb7f3d2bc1e4651b7f1e0ac6debd89a. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:24:15.288686 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:24:15.293368 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:24:15.357867 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-be3ab75b-b66f-4d65-82d7-de1c862dde32 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.080992 Jul 27 04:24:15.367007 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 126/262] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:24:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:24:15.379699 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-af2152f0-85bf-4677-a980-c24c98c1220f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:15.380554 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-af2152f0-85bf-4677-a980-c24c98c1220f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:15.481317 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-af2152f0-85bf-4677-a980-c24c98c1220f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:15.490450 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-af2152f0-85bf-4677-a980-c24c98c1220f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1245 microversion: 2.1 time: 0.122149 Jul 27 04:24:15.502269 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 137/263] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:15 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1245 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:16.521296 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-a2095ab5-a14f-4216-8b51-c78a764d8d6b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:16.522019 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-a2095ab5-a14f-4216-8b51-c78a764d8d6b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:16.535926 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a2095ab5-a14f-4216-8b51-c78a764d8d6b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:16.536384 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a2095ab5-a14f-4216-8b51-c78a764d8d6b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:16.537195 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a2095ab5-a14f-4216-8b51-c78a764d8d6b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:16.537650 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a2095ab5-a14f-4216-8b51-c78a764d8d6b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:16.638769 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-a2095ab5-a14f-4216-8b51-c78a764d8d6b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:16.647310 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-a2095ab5-a14f-4216-8b51-c78a764d8d6b tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1249 microversion: 2.1 time: 0.130333 Jul 27 04:24:16.647897 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 127/264] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:16 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1249 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:17.669749 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-dc23f965-8ef5-43cc-8424-cd94a834c884 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:17.670400 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-dc23f965-8ef5-43cc-8424-cd94a834c884 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:17.677017 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dc23f965-8ef5-43cc-8424-cd94a834c884 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:17.677466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dc23f965-8ef5-43cc-8424-cd94a834c884 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:17.678633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dc23f965-8ef5-43cc-8424-cd94a834c884 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:17.678755 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dc23f965-8ef5-43cc-8424-cd94a834c884 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:17.742907 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-dc23f965-8ef5-43cc-8424-cd94a834c884 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:17.751075 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-dc23f965-8ef5-43cc-8424-cd94a834c884 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1297 microversion: 2.1 time: 0.086460 Jul 27 04:24:17.751643 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 138/265] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:17 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:18.772674 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-cb93aef8-a175-499e-ac11-a59f96535142 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:18.775449 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-cb93aef8-a175-499e-ac11-a59f96535142 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:18.782706 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cb93aef8-a175-499e-ac11-a59f96535142 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:18.783350 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cb93aef8-a175-499e-ac11-a59f96535142 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:18.784609 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cb93aef8-a175-499e-ac11-a59f96535142 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:18.785152 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cb93aef8-a175-499e-ac11-a59f96535142 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:18.862865 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-cb93aef8-a175-499e-ac11-a59f96535142 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:18.870541 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-cb93aef8-a175-499e-ac11-a59f96535142 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1297 microversion: 2.1 time: 0.101636 Jul 27 04:24:18.871214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 128/266] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:18 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:19.891470 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-6a2c2759-0f7b-407a-ba2d-cb7035fd285e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:19.892224 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-6a2c2759-0f7b-407a-ba2d-cb7035fd285e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:19.894768 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:19.903840 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6a2c2759-0f7b-407a-ba2d-cb7035fd285e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:19.904299 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6a2c2759-0f7b-407a-ba2d-cb7035fd285e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:19.905082 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6a2c2759-0f7b-407a-ba2d-cb7035fd285e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:19.905523 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6a2c2759-0f7b-407a-ba2d-cb7035fd285e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:19.971769 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-6a2c2759-0f7b-407a-ba2d-cb7035fd285e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:19.981449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-6a2c2759-0f7b-407a-ba2d-cb7035fd285e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1297 microversion: 2.1 time: 0.093679 Jul 27 04:24:19.982347 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 139/267] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:19 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:21.002883 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-eefa1121-64c8-43ae-98f0-65978cf29d49 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:21.003575 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-eefa1121-64c8-43ae-98f0-65978cf29d49 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:21.005812 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:21.011743 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-eefa1121-64c8-43ae-98f0-65978cf29d49 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:21.012287 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-eefa1121-64c8-43ae-98f0-65978cf29d49 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:21.013114 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-eefa1121-64c8-43ae-98f0-65978cf29d49 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:21.013608 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-eefa1121-64c8-43ae-98f0-65978cf29d49 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:21.161572 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-eefa1121-64c8-43ae-98f0-65978cf29d49 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:21.173473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-eefa1121-64c8-43ae-98f0-65978cf29d49 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1371 microversion: 2.1 time: 0.174324 Jul 27 04:24:21.174252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 129/268] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:20 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:21.903800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-5bae36c2-0df7-40ec-beeb-bc1fe07ef525 req-37194df5-ec9f-4111-a1d4-28bad65c13f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1166f3-79b8-48f8-87a6-3c6da0593d1d", "tag": "07a12d67-caf1-42ba-a028-b0c5a40a4a5e"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:21.919949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-5bae36c2-0df7-40ec-beeb-bc1fe07ef525 req-37194df5-ec9f-4111-a1d4-28bad65c13f8 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:21.920813 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-5bae36c2-0df7-40ec-beeb-bc1fe07ef525 req-37194df5-ec9f-4111-a1d4-28bad65c13f8 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:22.083264 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-5bae36c2-0df7-40ec-beeb-bc1fe07ef525 req-37194df5-ec9f-4111-a1d4-28bad65c13f8 service nova] Creating event network-changed:07a12d67-caf1-42ba-a028-b0c5a40a4a5e for instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d on hv-cinder-85098 Jul 27 04:24:22.088392 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-5bae36c2-0df7-40ec-beeb-bc1fe07ef525 req-37194df5-ec9f-4111-a1d4-28bad65c13f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192682 Jul 27 04:24:22.088984 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 140/269] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:24:22.194924 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3c99136c-0418-42d7-a13d-d766bb08e791 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:22.195867 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-3c99136c-0418-42d7-a13d-d766bb08e791 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:22.202750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3c99136c-0418-42d7-a13d-d766bb08e791 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:22.203177 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3c99136c-0418-42d7-a13d-d766bb08e791 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:22.204136 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3c99136c-0418-42d7-a13d-d766bb08e791 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:22.204561 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3c99136c-0418-42d7-a13d-d766bb08e791 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:22.341645 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-3c99136c-0418-42d7-a13d-d766bb08e791 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:22.350011 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-3c99136c-0418-42d7-a13d-d766bb08e791 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1371 microversion: 2.1 time: 0.158844 Jul 27 04:24:22.350669 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 130/270] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:22 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:23.373669 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-303ff812-a379-4235-8ae1-9659a7bccb96 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:23.374437 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-303ff812-a379-4235-8ae1-9659a7bccb96 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:23.381269 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-303ff812-a379-4235-8ae1-9659a7bccb96 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:23.381801 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-303ff812-a379-4235-8ae1-9659a7bccb96 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:23.382527 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-303ff812-a379-4235-8ae1-9659a7bccb96 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:23.382960 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-303ff812-a379-4235-8ae1-9659a7bccb96 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:23.518276 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-303ff812-a379-4235-8ae1-9659a7bccb96 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:23.528172 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-303ff812-a379-4235-8ae1-9659a7bccb96 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1371 microversion: 2.1 time: 0.160816 Jul 27 04:24:23.528744 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 141/271] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:23 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:24.549599 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d5c59cd4-7b60-45ee-a981-8f7c22672080 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:24.550290 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d5c59cd4-7b60-45ee-a981-8f7c22672080 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:24.556976 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d5c59cd4-7b60-45ee-a981-8f7c22672080 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:24.557424 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d5c59cd4-7b60-45ee-a981-8f7c22672080 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:24.558236 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d5c59cd4-7b60-45ee-a981-8f7c22672080 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:24.558679 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d5c59cd4-7b60-45ee-a981-8f7c22672080 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:24.694228 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d5c59cd4-7b60-45ee-a981-8f7c22672080 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:24.703655 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d5c59cd4-7b60-45ee-a981-8f7c22672080 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1371 microversion: 2.1 time: 0.157865 Jul 27 04:24:24.704302 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 131/272] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:24 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:25.725498 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-18381724-4247-4560-8c48-919c19c51bcc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:25.726139 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-18381724-4247-4560-8c48-919c19c51bcc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:25.729077 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=10 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:25.734702 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18381724-4247-4560-8c48-919c19c51bcc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:25.735150 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18381724-4247-4560-8c48-919c19c51bcc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:25.735921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18381724-4247-4560-8c48-919c19c51bcc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:25.736360 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18381724-4247-4560-8c48-919c19c51bcc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:25.908865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-18381724-4247-4560-8c48-919c19c51bcc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:25.919706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-18381724-4247-4560-8c48-919c19c51bcc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1371 microversion: 2.1 time: 0.197950 Jul 27 04:24:25.934904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 142/273] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:25 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:26.941845 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-130770e1-9c06-47eb-9f07-359f8ad6aca9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:26.942523 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-130770e1-9c06-47eb-9f07-359f8ad6aca9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:26.944286 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:26.944958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=10 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:26.952027 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-130770e1-9c06-47eb-9f07-359f8ad6aca9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:26.952472 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-130770e1-9c06-47eb-9f07-359f8ad6aca9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:26.953229 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-130770e1-9c06-47eb-9f07-359f8ad6aca9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:26.953661 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-130770e1-9c06-47eb-9f07-359f8ad6aca9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:27.095987 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-130770e1-9c06-47eb-9f07-359f8ad6aca9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:27.104165 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-130770e1-9c06-47eb-9f07-359f8ad6aca9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1371 microversion: 2.1 time: 0.166083 Jul 27 04:24:27.104731 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 132/274] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:26 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:28.124819 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-cefc1a52-21f2-4788-b6af-4d4a5c2266e1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:28.125424 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-cefc1a52-21f2-4788-b6af-4d4a5c2266e1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:28.131860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cefc1a52-21f2-4788-b6af-4d4a5c2266e1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:28.132327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cefc1a52-21f2-4788-b6af-4d4a5c2266e1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:28.133062 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cefc1a52-21f2-4788-b6af-4d4a5c2266e1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:28.133505 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cefc1a52-21f2-4788-b6af-4d4a5c2266e1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:28.262545 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-cefc1a52-21f2-4788-b6af-4d4a5c2266e1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:28.270064 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-cefc1a52-21f2-4788-b6af-4d4a5c2266e1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1371 microversion: 2.1 time: 0.149018 Jul 27 04:24:28.270642 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 143/275] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:28 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:29.292445 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7e22f461-1522-4acc-b926-aa38a13258b1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:29.293064 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-7e22f461-1522-4acc-b926-aa38a13258b1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:29.299194 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7e22f461-1522-4acc-b926-aa38a13258b1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:29.299632 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7e22f461-1522-4acc-b926-aa38a13258b1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:29.300378 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7e22f461-1522-4acc-b926-aa38a13258b1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:29.300804 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7e22f461-1522-4acc-b926-aa38a13258b1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:29.437445 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-7e22f461-1522-4acc-b926-aa38a13258b1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:29.449347 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-7e22f461-1522-4acc-b926-aa38a13258b1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1371 microversion: 2.1 time: 0.158013 Jul 27 04:24:29.449347 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 133/276] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:29 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:30.466729 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4ec5711e-96c6-40e0-9892-92d79fa7eed6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:30.468729 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4ec5711e-96c6-40e0-9892-92d79fa7eed6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:30.475754 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4ec5711e-96c6-40e0-9892-92d79fa7eed6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:30.476198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4ec5711e-96c6-40e0-9892-92d79fa7eed6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:30.476964 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4ec5711e-96c6-40e0-9892-92d79fa7eed6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:30.478397 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4ec5711e-96c6-40e0-9892-92d79fa7eed6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:30.480650 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:30.620242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4ec5711e-96c6-40e0-9892-92d79fa7eed6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:30.627773 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4ec5711e-96c6-40e0-9892-92d79fa7eed6 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1371 microversion: 2.1 time: 0.165524 Jul 27 04:24:30.628331 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 144/277] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:30 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:31.648528 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2c9d0011-e2de-48a6-bacd-f86777d68879 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:31.649716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2c9d0011-e2de-48a6-bacd-f86777d68879 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:31.656462 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2c9d0011-e2de-48a6-bacd-f86777d68879 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:31.656906 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2c9d0011-e2de-48a6-bacd-f86777d68879 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:31.657677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2c9d0011-e2de-48a6-bacd-f86777d68879 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:31.658143 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2c9d0011-e2de-48a6-bacd-f86777d68879 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:31.792717 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2c9d0011-e2de-48a6-bacd-f86777d68879 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:31.802105 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2c9d0011-e2de-48a6-bacd-f86777d68879 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1371 microversion: 2.1 time: 0.157362 Jul 27 04:24:31.802667 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 134/278] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:31 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:32.822934 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e1496524-697a-4702-987b-78a3bff18183 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:32.823531 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e1496524-697a-4702-987b-78a3bff18183 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:32.830258 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e1496524-697a-4702-987b-78a3bff18183 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:32.830713 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e1496524-697a-4702-987b-78a3bff18183 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:32.831482 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e1496524-697a-4702-987b-78a3bff18183 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:32.831920 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e1496524-697a-4702-987b-78a3bff18183 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:32.967472 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e1496524-697a-4702-987b-78a3bff18183 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:32.974899 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e1496524-697a-4702-987b-78a3bff18183 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1371 microversion: 2.1 time: 0.156804 Jul 27 04:24:32.975484 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 145/279] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:32 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:33.216738 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-8058f790-4e5c-49ac-b586-9dec81c8e8f6 req-39345b6d-08bd-43b4-ae80-211208fe1e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1166f3-79b8-48f8-87a6-3c6da0593d1d", "name": "network-vif-plugged", "status": "completed", "tag": "07a12d67-caf1-42ba-a028-b0c5a40a4a5e"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:33.226701 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-8058f790-4e5c-49ac-b586-9dec81c8e8f6 req-39345b6d-08bd-43b4-ae80-211208fe1e08 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:33.227145 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-8058f790-4e5c-49ac-b586-9dec81c8e8f6 req-39345b6d-08bd-43b4-ae80-211208fe1e08 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:33.238869 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-8058f790-4e5c-49ac-b586-9dec81c8e8f6 req-39345b6d-08bd-43b4-ae80-211208fe1e08 service nova] Creating event network-vif-plugged:07a12d67-caf1-42ba-a028-b0c5a40a4a5e for instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d on hv-cinder-85098 Jul 27 04:24:33.246133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-8058f790-4e5c-49ac-b586-9dec81c8e8f6 req-39345b6d-08bd-43b4-ae80-211208fe1e08 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032930 Jul 27 04:24:33.246776 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 135/280] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:24:33.441495 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-29268c68-c6a1-4c7b-a6f7-726e1e587cf6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:33.442063 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-29268c68-c6a1-4c7b-a6f7-726e1e587cf6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:33.448572 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-29268c68-c6a1-4c7b-a6f7-726e1e587cf6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:33.449040 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-29268c68-c6a1-4c7b-a6f7-726e1e587cf6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:33.449837 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-29268c68-c6a1-4c7b-a6f7-726e1e587cf6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:33.450962 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-29268c68-c6a1-4c7b-a6f7-726e1e587cf6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:33.581797 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-29268c68-c6a1-4c7b-a6f7-726e1e587cf6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lazy-loading 'services' on Instance uuid aadf0a0b-7c0d-4640-aef4-aeb891aebca7 {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:24:33.703387 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-29268c68-c6a1-4c7b-a6f7-726e1e587cf6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7/os-volume_attachments/e135d3da-4204-450f-b7c3-2867b1570807" status: 202 len: 0 microversion: 2.1 time: 0.265726 Jul 27 04:24:33.703970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 146/281] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Jul 27 04:24:33 2022] DELETE /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7/os-volume_attachments/e135d3da-4204-450f-b7c3-2867b1570807 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:24:33.996316 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6158b428-f2ff-40bf-8adc-fbbbf8241430 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:33.996912 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6158b428-f2ff-40bf-8adc-fbbbf8241430 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:34.003303 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6158b428-f2ff-40bf-8adc-fbbbf8241430 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:34.003745 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6158b428-f2ff-40bf-8adc-fbbbf8241430 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:34.004514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6158b428-f2ff-40bf-8adc-fbbbf8241430 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:34.004949 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6158b428-f2ff-40bf-8adc-fbbbf8241430 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:34.145998 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6158b428-f2ff-40bf-8adc-fbbbf8241430 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:34.155290 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6158b428-f2ff-40bf-8adc-fbbbf8241430 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1371 microversion: 2.1 time: 0.163425 Jul 27 04:24:34.155862 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 136/282] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:33 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:34.884608 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1587389803", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-436101483", "security_groups": [{"name": "tempest-secgroup-smoke-552524238"}], "networks": [{"uuid": "8a3b8b27-d16f-46fa-9ba4-2fd6c4bd554e"}], "block_device_mapping_v2": [{"uuid": "4268a934-4c5f-4164-8f6a-0ca22fa05f0b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:35.012323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.network.neutron [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] validate_networks() for [('8a3b8b27-d16f-46fa-9ba4-2fd6c4bd554e', None, None, None, None, None)] {{(pid=117740) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:24:35.176042 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-89c51648-7a8b-4244-846b-eac2a90c19e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:35.176645 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-89c51648-7a8b-4244-846b-eac2a90c19e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:35.183572 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-89c51648-7a8b-4244-846b-eac2a90c19e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:35.184017 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-89c51648-7a8b-4244-846b-eac2a90c19e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:35.184781 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-89c51648-7a8b-4244-846b-eac2a90c19e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:35.185210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-89c51648-7a8b-4244-846b-eac2a90c19e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:35.324630 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-89c51648-7a8b-4244-846b-eac2a90c19e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:35.332946 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-89c51648-7a8b-4244-846b-eac2a90c19e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1371 microversion: 2.1 time: 0.160720 Jul 27 04:24:35.333536 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 137/283] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:35 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:35.394204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Flavor limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:24:35.394802 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Image limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:24:35.395100 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Flavor pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:24:35.395494 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Image pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:24:35.395903 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:24:35.405423 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:35.405872 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:35.406704 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:35.407142 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:35.425911 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Getting quotas for project 992437dfa6ef4c678ea5d4f92155cf17. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:24:35.429900 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Getting quotas for user 5a7f399240ee4003b0e72fd34d96f47b and project 992437dfa6ef4c678ea5d4f92155cf17. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:24:35.488313 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Going to run 1 instances... {{(pid=117740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:24:35.491440 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4268a934-4c5f-4164-8f6a-0ca22fa05f0b',volume_size=None,volume_type=None)] {{(pid=117740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:24:35.631055 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-52c190f2-3016-457b-9d47-b019523fecb2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.751444 Jul 27 04:24:35.631714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 147/284] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:24:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:24:35.643633 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-96548ddf-fb34-4611-888c-581c15e0266b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:35.644249 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-96548ddf-fb34-4611-888c-581c15e0266b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:35.698857 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-96548ddf-fb34-4611-888c-581c15e0266b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:35.705494 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-96548ddf-fb34-4611-888c-581c15e0266b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1088 microversion: 2.1 time: 0.065711 Jul 27 04:24:35.706109 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 138/285] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:35 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:35.906440 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-fb2cc158-2da7-452f-8b67-e77c61917f86 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:35.907009 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-fb2cc158-2da7-452f-8b67-e77c61917f86 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:35.914656 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fb2cc158-2da7-452f-8b67-e77c61917f86 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:35.915328 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fb2cc158-2da7-452f-8b67-e77c61917f86 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:35.916209 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fb2cc158-2da7-452f-8b67-e77c61917f86 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:35.916655 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fb2cc158-2da7-452f-8b67-e77c61917f86 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:35.949310 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-fb2cc158-2da7-452f-8b67-e77c61917f86 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Going to try to terminate instance {{(pid=117740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:24:36.032224 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-fb2cc158-2da7-452f-8b67-e77c61917f86 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 204 len: 0 microversion: 2.1 time: 0.130424 Jul 27 04:24:36.033101 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 148/286] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:24:35 2022] DELETE /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:24:36.041754 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-cbc70f62-829f-49f0-9cb3-82eed5ebec18 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:36.042657 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-cbc70f62-829f-49f0-9cb3-82eed5ebec18 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:36.049261 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cbc70f62-829f-49f0-9cb3-82eed5ebec18 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:36.049714 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cbc70f62-829f-49f0-9cb3-82eed5ebec18 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:36.050539 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cbc70f62-829f-49f0-9cb3-82eed5ebec18 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:36.050980 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cbc70f62-829f-49f0-9cb3-82eed5ebec18 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:36.181196 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-cbc70f62-829f-49f0-9cb3-82eed5ebec18 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:36.188840 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-cbc70f62-829f-49f0-9cb3-82eed5ebec18 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1513 microversion: 2.1 time: 0.151742 Jul 27 04:24:36.189409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 139/287] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:36 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:36.354837 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-538324aa-40f1-4fc3-8553-adc1d1e582e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:36.355567 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-538324aa-40f1-4fc3-8553-adc1d1e582e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:36.361513 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-538324aa-40f1-4fc3-8553-adc1d1e582e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:36.361962 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-538324aa-40f1-4fc3-8553-adc1d1e582e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:36.362750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-538324aa-40f1-4fc3-8553-adc1d1e582e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:36.363189 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-538324aa-40f1-4fc3-8553-adc1d1e582e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:36.496117 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-538324aa-40f1-4fc3-8553-adc1d1e582e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:36.503671 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-538324aa-40f1-4fc3-8553-adc1d1e582e9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1564 microversion: 2.1 time: 0.153170 Jul 27 04:24:36.504237 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 149/288] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:36 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:36.524109 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f019f170-1d96-4bc5-856a-10a861f6209a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:36.525422 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f019f170-1d96-4bc5-856a-10a861f6209a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:36.531546 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f019f170-1d96-4bc5-856a-10a861f6209a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:36.531995 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f019f170-1d96-4bc5-856a-10a861f6209a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:36.532750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f019f170-1d96-4bc5-856a-10a861f6209a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:36.533180 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f019f170-1d96-4bc5-856a-10a861f6209a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:36.613152 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f019f170-1d96-4bc5-856a-10a861f6209a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092854 Jul 27 04:24:36.613752 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 140/289] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Jul 27 04:24:36 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:24:36.726626 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4ef146ca-0e83-48c6-bc67-032cc38fd2bf tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:36.727248 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4ef146ca-0e83-48c6-bc67-032cc38fd2bf tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:36.733864 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4ef146ca-0e83-48c6-bc67-032cc38fd2bf tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:36.734420 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4ef146ca-0e83-48c6-bc67-032cc38fd2bf tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:36.735190 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4ef146ca-0e83-48c6-bc67-032cc38fd2bf tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:36.735629 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4ef146ca-0e83-48c6-bc67-032cc38fd2bf tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:36.798135 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4ef146ca-0e83-48c6-bc67-032cc38fd2bf tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:36.806667 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4ef146ca-0e83-48c6-bc67-032cc38fd2bf tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1138 microversion: 2.1 time: 0.083577 Jul 27 04:24:36.807174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 150/290] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:36 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:24:37.210672 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-a94e2a7e-e713-414c-8ebf-768e631a2e92 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:37.211282 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-a94e2a7e-e713-414c-8ebf-768e631a2e92 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:37.220416 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a94e2a7e-e713-414c-8ebf-768e631a2e92 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:37.220862 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a94e2a7e-e713-414c-8ebf-768e631a2e92 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:37.221632 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a94e2a7e-e713-414c-8ebf-768e631a2e92 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:37.222094 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a94e2a7e-e713-414c-8ebf-768e631a2e92 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:37.679620 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-a94e2a7e-e713-414c-8ebf-768e631a2e92 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:37.687725 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-a94e2a7e-e713-414c-8ebf-768e631a2e92 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1513 microversion: 2.1 time: 0.480968 Jul 27 04:24:37.688296 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 141/291] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:37 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1513 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:37.827928 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ba49cfb1-6e33-4450-abc9-46c3ec7d0f7d tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:37.828533 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ba49cfb1-6e33-4450-abc9-46c3ec7d0f7d tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:37.834996 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba49cfb1-6e33-4450-abc9-46c3ec7d0f7d tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:37.835436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba49cfb1-6e33-4450-abc9-46c3ec7d0f7d tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:37.836193 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba49cfb1-6e33-4450-abc9-46c3ec7d0f7d tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:37.836624 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba49cfb1-6e33-4450-abc9-46c3ec7d0f7d tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:37.911380 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ba49cfb1-6e33-4450-abc9-46c3ec7d0f7d tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:37.919758 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ba49cfb1-6e33-4450-abc9-46c3ec7d0f7d tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1130 microversion: 2.1 time: 0.095739 Jul 27 04:24:37.920339 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 151/292] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:37 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1130 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:38.058764 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-efbc7b3c-b7bf-43b0-9fc0-eaa302ce1811 req-bb8e5a29-868b-4ff9-a4f0-b9a38462bc3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1166f3-79b8-48f8-87a6-3c6da0593d1d", "tag": "07a12d67-caf1-42ba-a028-b0c5a40a4a5e"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:38.073687 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-efbc7b3c-b7bf-43b0-9fc0-eaa302ce1811 req-bb8e5a29-868b-4ff9-a4f0-b9a38462bc3b service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:38.074147 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-efbc7b3c-b7bf-43b0-9fc0-eaa302ce1811 req-bb8e5a29-868b-4ff9-a4f0-b9a38462bc3b service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:38.085369 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-efbc7b3c-b7bf-43b0-9fc0-eaa302ce1811 req-bb8e5a29-868b-4ff9-a4f0-b9a38462bc3b service nova] Creating event network-changed:07a12d67-caf1-42ba-a028-b0c5a40a4a5e for instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d on hv-cinder-85098 Jul 27 04:24:38.090706 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-efbc7b3c-b7bf-43b0-9fc0-eaa302ce1811 req-bb8e5a29-868b-4ff9-a4f0-b9a38462bc3b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037229 Jul 27 04:24:38.091293 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 142/293] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:24:38.710574 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d01a1b3b-5659-4cb7-b4c3-089295c20f4e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:38.712438 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d01a1b3b-5659-4cb7-b4c3-089295c20f4e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:38.721081 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d01a1b3b-5659-4cb7-b4c3-089295c20f4e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:38.722157 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d01a1b3b-5659-4cb7-b4c3-089295c20f4e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:38.723229 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d01a1b3b-5659-4cb7-b4c3-089295c20f4e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:38.723986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d01a1b3b-5659-4cb7-b4c3-089295c20f4e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:38.941487 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b986802a-b6df-4e26-b914-0ec3481e4c02 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:38.942334 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-b986802a-b6df-4e26-b914-0ec3481e4c02 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:38.949139 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b986802a-b6df-4e26-b914-0ec3481e4c02 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:38.949831 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b986802a-b6df-4e26-b914-0ec3481e4c02 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:38.950973 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b986802a-b6df-4e26-b914-0ec3481e4c02 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:38.951711 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b986802a-b6df-4e26-b914-0ec3481e4c02 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:39.038725 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-b986802a-b6df-4e26-b914-0ec3481e4c02 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:39.043236 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d01a1b3b-5659-4cb7-b4c3-089295c20f4e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:39.055318 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d01a1b3b-5659-4cb7-b4c3-089295c20f4e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 200 len: 1513 microversion: 2.1 time: 0.348670 Jul 27 04:24:39.058899 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-b986802a-b6df-4e26-b914-0ec3481e4c02 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1204 microversion: 2.1 time: 0.121822 Jul 27 04:24:39.059509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 143/294] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:38 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1204 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:39.061734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 152/295] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:38 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 1513 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:39.404102 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-a4e19e92-e191-448c-b7e8-8de757a068d5 req-b649d602-f9e6-48fd-aac4-cadc45e080fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aadf0a0b-7c0d-4640-aef4-aeb891aebca7", "name": "network-vif-deleted", "tag": "b68c0a7d-2c9e-465f-8f30-414ec22bf612"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:39.413296 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-a4e19e92-e191-448c-b7e8-8de757a068d5 req-b649d602-f9e6-48fd-aac4-cadc45e080fb service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:39.413739 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-a4e19e92-e191-448c-b7e8-8de757a068d5 req-b649d602-f9e6-48fd-aac4-cadc45e080fb service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:39.425297 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-a4e19e92-e191-448c-b7e8-8de757a068d5 req-b649d602-f9e6-48fd-aac4-cadc45e080fb service nova] Creating event network-vif-deleted:b68c0a7d-2c9e-465f-8f30-414ec22bf612 for instance aadf0a0b-7c0d-4640-aef4-aeb891aebca7 on hv-cinder-85098 Jul 27 04:24:39.430151 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-a4e19e92-e191-448c-b7e8-8de757a068d5 req-b649d602-f9e6-48fd-aac4-cadc45e080fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029611 Jul 27 04:24:39.431512 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 144/296] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:24:40.082608 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-948b6254-5da2-4149-9c84-a255d9bc126e tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:40.083437 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-948b6254-5da2-4149-9c84-a255d9bc126e tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:40.091195 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-948b6254-5da2-4149-9c84-a255d9bc126e tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:40.091790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-948b6254-5da2-4149-9c84-a255d9bc126e tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:40.093030 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-948b6254-5da2-4149-9c84-a255d9bc126e tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:40.094060 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-948b6254-5da2-4149-9c84-a255d9bc126e tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:40.099258 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0488565d-8abc-4875-9eee-8d96dc492ed0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:40.100014 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0488565d-8abc-4875-9eee-8d96dc492ed0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: aadf0a0b-7c0d-4640-aef4-aeb891aebca7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:40.108209 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0488565d-8abc-4875-9eee-8d96dc492ed0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:40.108674 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0488565d-8abc-4875-9eee-8d96dc492ed0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:40.109671 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0488565d-8abc-4875-9eee-8d96dc492ed0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:40.110283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0488565d-8abc-4875-9eee-8d96dc492ed0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:40.128250 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-0488565d-8abc-4875-9eee-8d96dc492ed0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] HTTP exception thrown: Instance aadf0a0b-7c0d-4640-aef4-aeb891aebca7 could not be found. Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0488565d-8abc-4875-9eee-8d96dc492ed0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Request method failure captured: Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 HTTP/1.1 Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L2tzZvgQnplZ2sLCrInmw0QEPRP_r9vCSlLlcnvsShWijvZH4aDxI5rK7sKkcZbc3Sdk5bmxHkNW617KDm15n3ECHSQFIjGQeLgf3vc862dRDXdRNSg4UnqVB03vVLX8R1Namy2RmMnpB2JWBK1fkYd54v62Ptm-tMFsAxgMxZESwM Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: a4c6bc5f81ac457dbb91c5bc1a8f0d61 Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-VolumesSnapshotTestJSON-341356136 Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:24:40.129900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:24:40.131491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a4c6bc5f81ac457dbb91c5bc1a8f0d61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a4c6bc5f81ac457dbb91c5bc1a8f0d61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a4c6bc5f81ac457dbb91c5bc1a8f0d61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a4c6bc5f81ac457dbb91c5bc1a8f0d61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:24:40.131491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-VolumesSnapshotTestJSON-341356136 Jul 27 04:24:40.131491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: a4c6bc5f81ac457dbb91c5bc1a8f0d61 Jul 27 04:24:40.131491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-341356136 Jul 27 04:24:40.131491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-VolumesSnapshotTestJSON-341356136-project Jul 27 04:24:40.131491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:24:40.131491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:24:40.131491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 937a7097c9d84402882f73082cfa408f Jul 27 04:24:40.131491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-VolumesSnapshotTestJSON-341356136-project Jul 27 04:24:40.131491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:24:40.131491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance aadf0a0b-7c0d-4640-aef4-aeb891aebca7 could not be found. Jul 27 04:24:40.131491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': 'aadf0a0b-7c0d-4640-aef4-aeb891aebca7'} Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aadf0a0b-7c0d-4640-aef4-aeb891aebca7 could not be found. Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:24:40.132878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aadf0a0b-7c0d-4640-aef4-aeb891aebca7 could not be found. Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aadf0a0b-7c0d-4640-aef4-aeb891aebca7 could not be found. Jul 27 04:24:40.135333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:24:40.136677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0488565d-8abc-4875-9eee-8d96dc492ed0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Returning 404 to user: Instance aadf0a0b-7c0d-4640-aef4-aeb891aebca7 could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:24:40.136677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0488565d-8abc-4875-9eee-8d96dc492ed0 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7" status: 404 len: 111 microversion: 2.1 time: 0.039388 Jul 27 04:24:40.136677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 145/297] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:40 2022] GET /compute/v2.1/servers/aadf0a0b-7c0d-4640-aef4-aeb891aebca7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 04:24:40.317863 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-948b6254-5da2-4149-9c84-a255d9bc126e tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:40.344152 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-948b6254-5da2-4149-9c84-a255d9bc126e tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.265327 Jul 27 04:24:40.344778 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 153/298] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:40 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:41.243795 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-601804440", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1427079078", "security_groups": [{"name": "tempest-secgroup-smoke-245786739"}], "block_device_mapping_v2": [{"uuid": "dc2eb467-1706-42f1-b720-0c16bf31e5e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87fd5d56-0e62-4bdf-a522-882668de212a"}]}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:41.359497 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] validate_networks() for [('87fd5d56-0e62-4bdf-a522-882668de212a', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:24:41.370261 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-70f96da1-a34a-4211-8e89-ab90d7fe946b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:41.370866 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-70f96da1-a34a-4211-8e89-ab90d7fe946b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:41.377309 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-70f96da1-a34a-4211-8e89-ab90d7fe946b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:41.377749 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-70f96da1-a34a-4211-8e89-ab90d7fe946b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:41.378536 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-70f96da1-a34a-4211-8e89-ab90d7fe946b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:41.378966 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-70f96da1-a34a-4211-8e89-ab90d7fe946b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:41.546645 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-70f96da1-a34a-4211-8e89-ab90d7fe946b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:41.554014 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-70f96da1-a34a-4211-8e89-ab90d7fe946b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.188264 Jul 27 04:24:41.554791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 154/299] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:41 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:24:41.559245 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-b413d102-d510-473d-9295-539c4755e168 req-d4217ef4-e576-46e9-a9ff-bb305d6ca9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5496cce3-6266-4650-84ba-9e01e99cbea6", "tag": "69fb12ed-2ec4-4ba8-a2dd-7b56427bd104"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:41.568400 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-b413d102-d510-473d-9295-539c4755e168 req-d4217ef4-e576-46e9-a9ff-bb305d6ca9c2 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:41.568835 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-b413d102-d510-473d-9295-539c4755e168 req-d4217ef4-e576-46e9-a9ff-bb305d6ca9c2 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:41.581996 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-b413d102-d510-473d-9295-539c4755e168 req-d4217ef4-e576-46e9-a9ff-bb305d6ca9c2 service nova] Creating event network-changed:69fb12ed-2ec4-4ba8-a2dd-7b56427bd104 for instance 5496cce3-6266-4650-84ba-9e01e99cbea6 on hv-cinder-85098 Jul 27 04:24:41.587500 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-b413d102-d510-473d-9295-539c4755e168 req-d4217ef4-e576-46e9-a9ff-bb305d6ca9c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030967 Jul 27 04:24:41.588085 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 155/300] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:24:41.734962 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:24:41.735377 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:24:41.735842 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:24:41.736243 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:24:41.736645 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:24:41.745326 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:41.745762 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:41.746591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:41.747019 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:41.763715 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Getting quotas for project 3825c2630a4f47e0b029bd0c90875108. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:24:41.767695 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Getting quotas for user eea5b08eede4409484dc2f4305b5298a and project 3825c2630a4f47e0b029bd0c90875108. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:24:41.825266 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:24:41.827348 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc2eb467-1706-42f1-b720-0c16bf31e5e4',volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:24:41.953787 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-12946cc5-9a15-42f6-ac55-501471eda461 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.714415 Jul 27 04:24:41.954450 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 146/301] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:24:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:24:41.966494 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f45dd5e6-c171-4bf9-862d-4bf36753e545 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:41.967312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f45dd5e6-c171-4bf9-862d-4bf36753e545 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:42.025366 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f45dd5e6-c171-4bf9-862d-4bf36753e545 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:42.032269 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f45dd5e6-c171-4bf9-862d-4bf36753e545 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1094 microversion: 2.1 time: 0.070666 Jul 27 04:24:42.033007 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 156/302] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:41 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:24:42.576012 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f4c67071-e812-4d6b-bc9e-b37f4c180964 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:42.576544 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f4c67071-e812-4d6b-bc9e-b37f4c180964 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:42.583173 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f4c67071-e812-4d6b-bc9e-b37f4c180964 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:42.583622 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f4c67071-e812-4d6b-bc9e-b37f4c180964 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:42.584385 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f4c67071-e812-4d6b-bc9e-b37f4c180964 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:42.584824 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f4c67071-e812-4d6b-bc9e-b37f4c180964 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:42.720776 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f4c67071-e812-4d6b-bc9e-b37f4c180964 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:42.728657 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f4c67071-e812-4d6b-bc9e-b37f4c180964 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.156661 Jul 27 04:24:42.729206 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 147/303] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:42 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:43.053018 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-95bf6045-3f70-41a6-baaa-d58b576f0b8f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:43.053620 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-95bf6045-3f70-41a6-baaa-d58b576f0b8f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:43.060707 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-95bf6045-3f70-41a6-baaa-d58b576f0b8f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:43.061149 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-95bf6045-3f70-41a6-baaa-d58b576f0b8f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:43.061900 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-95bf6045-3f70-41a6-baaa-d58b576f0b8f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:43.062354 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-95bf6045-3f70-41a6-baaa-d58b576f0b8f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:43.121941 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-95bf6045-3f70-41a6-baaa-d58b576f0b8f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:43.130297 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-95bf6045-3f70-41a6-baaa-d58b576f0b8f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1144 microversion: 2.1 time: 0.080991 Jul 27 04:24:43.131068 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 157/304] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:43 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:43.749388 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-fc92b4e6-f7ca-4716-b582-d76f6b875b16 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:43.749944 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-fc92b4e6-f7ca-4716-b582-d76f6b875b16 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:43.755804 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fc92b4e6-f7ca-4716-b582-d76f6b875b16 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:43.756246 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fc92b4e6-f7ca-4716-b582-d76f6b875b16 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:43.757003 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fc92b4e6-f7ca-4716-b582-d76f6b875b16 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:43.757437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fc92b4e6-f7ca-4716-b582-d76f6b875b16 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:43.761819 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=100 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:43.887382 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-fc92b4e6-f7ca-4716-b582-d76f6b875b16 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:43.895177 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-fc92b4e6-f7ca-4716-b582-d76f6b875b16 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.149498 Jul 27 04:24:43.895558 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 148/305] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:43 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:44.153101 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-02a09386-c551-49a8-8a20-538948fb97c8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:44.153735 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-02a09386-c551-49a8-8a20-538948fb97c8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:44.160232 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-02a09386-c551-49a8-8a20-538948fb97c8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:44.160679 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-02a09386-c551-49a8-8a20-538948fb97c8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:44.161451 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-02a09386-c551-49a8-8a20-538948fb97c8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:44.161885 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-02a09386-c551-49a8-8a20-538948fb97c8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:44.224249 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-02a09386-c551-49a8-8a20-538948fb97c8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:44.232971 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-02a09386-c551-49a8-8a20-538948fb97c8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1210 microversion: 2.1 time: 0.085201 Jul 27 04:24:44.233521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 158/306] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:44 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:44.917447 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-634fdb6d-c9f4-4053-a7a1-dae2979ec71c tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:44.918072 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-634fdb6d-c9f4-4053-a7a1-dae2979ec71c tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:44.923990 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-634fdb6d-c9f4-4053-a7a1-dae2979ec71c tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:44.924441 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-634fdb6d-c9f4-4053-a7a1-dae2979ec71c tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:44.925247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-634fdb6d-c9f4-4053-a7a1-dae2979ec71c tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:44.925706 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-634fdb6d-c9f4-4053-a7a1-dae2979ec71c tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:45.061577 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-634fdb6d-c9f4-4053-a7a1-dae2979ec71c tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:45.069076 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-634fdb6d-c9f4-4053-a7a1-dae2979ec71c tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.156238 Jul 27 04:24:45.069721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 149/307] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:44 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:45.254390 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-931df5ef-58d0-4f47-8edd-4668149fa787 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:45.254994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-931df5ef-58d0-4f47-8edd-4668149fa787 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:45.262464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-931df5ef-58d0-4f47-8edd-4668149fa787 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:45.262912 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-931df5ef-58d0-4f47-8edd-4668149fa787 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:45.263680 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-931df5ef-58d0-4f47-8edd-4668149fa787 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:45.264111 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-931df5ef-58d0-4f47-8edd-4668149fa787 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:45.395709 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-931df5ef-58d0-4f47-8edd-4668149fa787 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:45.403478 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-931df5ef-58d0-4f47-8edd-4668149fa787 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.153086 Jul 27 04:24:45.404038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 159/308] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:45 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:46.092618 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-40bfb351-3ad0-412e-a402-61c4609766d8 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:46.093231 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-40bfb351-3ad0-412e-a402-61c4609766d8 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:46.099192 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-40bfb351-3ad0-412e-a402-61c4609766d8 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:46.099632 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-40bfb351-3ad0-412e-a402-61c4609766d8 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:46.100384 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-40bfb351-3ad0-412e-a402-61c4609766d8 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:46.100814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-40bfb351-3ad0-412e-a402-61c4609766d8 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:46.230849 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-40bfb351-3ad0-412e-a402-61c4609766d8 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:46.238092 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-40bfb351-3ad0-412e-a402-61c4609766d8 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.149292 Jul 27 04:24:46.238653 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 150/309] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:46 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:46.425018 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-55989a28-692d-4ecc-a94c-cb82e65d8adc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:46.425624 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-55989a28-692d-4ecc-a94c-cb82e65d8adc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:46.427550 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:46.434036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-55989a28-692d-4ecc-a94c-cb82e65d8adc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:46.434479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-55989a28-692d-4ecc-a94c-cb82e65d8adc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:46.435233 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-55989a28-692d-4ecc-a94c-cb82e65d8adc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:46.435661 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-55989a28-692d-4ecc-a94c-cb82e65d8adc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:46.568204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-55989a28-692d-4ecc-a94c-cb82e65d8adc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:46.570659 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:46.576865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-55989a28-692d-4ecc-a94c-cb82e65d8adc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.155769 Jul 27 04:24:46.577436 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 160/310] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:46 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:47.259415 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-cde2cb5f-7186-4a33-8feb-16579f698153 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:47.260614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-cde2cb5f-7186-4a33-8feb-16579f698153 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:47.266977 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cde2cb5f-7186-4a33-8feb-16579f698153 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:47.267427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cde2cb5f-7186-4a33-8feb-16579f698153 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:47.268212 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cde2cb5f-7186-4a33-8feb-16579f698153 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:47.268643 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cde2cb5f-7186-4a33-8feb-16579f698153 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:47.404153 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-cde2cb5f-7186-4a33-8feb-16579f698153 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:47.411506 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-cde2cb5f-7186-4a33-8feb-16579f698153 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.156696 Jul 27 04:24:47.412059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 151/311] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:47 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:47.599565 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-57d948a5-6dc9-4e90-9bdd-523854ddfaf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:47.600171 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-57d948a5-6dc9-4e90-9bdd-523854ddfaf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:47.608235 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-57d948a5-6dc9-4e90-9bdd-523854ddfaf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:47.608679 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-57d948a5-6dc9-4e90-9bdd-523854ddfaf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:47.609444 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-57d948a5-6dc9-4e90-9bdd-523854ddfaf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:47.609872 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-57d948a5-6dc9-4e90-9bdd-523854ddfaf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:47.906257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-57d948a5-6dc9-4e90-9bdd-523854ddfaf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:47.913804 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-57d948a5-6dc9-4e90-9bdd-523854ddfaf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.319307 Jul 27 04:24:47.915324 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 161/312] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:47 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:48.004655 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-583338145", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "networks": [{"uuid": "478b4ed1-67de-4059-a9f2-3b59a8e77b95"}]}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:48.062582 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] validate_networks() for [('478b4ed1-67de-4059-a9f2-3b59a8e77b95', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:24:48.383195 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-f808752f-c847-4f7e-80c5-55b758ef5e3f req-f09550c6-b7e3-4792-bf09-e0a0cb124a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1dc2957-3830-46b6-b50c-05806cb4e259", "tag": "c8fba684-60c7-4ea8-891e-bf8550d838f9"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:48.404246 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-f808752f-c847-4f7e-80c5-55b758ef5e3f req-f09550c6-b7e3-4792-bf09-e0a0cb124a14 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:48.405725 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-f808752f-c847-4f7e-80c5-55b758ef5e3f req-f09550c6-b7e3-4792-bf09-e0a0cb124a14 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:48.434719 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-f808752f-c847-4f7e-80c5-55b758ef5e3f req-f09550c6-b7e3-4792-bf09-e0a0cb124a14 service nova] Creating event network-changed:c8fba684-60c7-4ea8-891e-bf8550d838f9 for instance a1dc2957-3830-46b6-b50c-05806cb4e259 on hv-cinder-85098 Jul 27 04:24:48.440673 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-f808752f-c847-4f7e-80c5-55b758ef5e3f req-f09550c6-b7e3-4792-bf09-e0a0cb124a14 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060845 Jul 27 04:24:48.442211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 162/313] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:24:48.458111 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d1cdb4d7-1f54-4876-9b35-407328e59521 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:48.459095 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d1cdb4d7-1f54-4876-9b35-407328e59521 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:48.476307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d1cdb4d7-1f54-4876-9b35-407328e59521 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:48.480915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d1cdb4d7-1f54-4876-9b35-407328e59521 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:48.482129 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d1cdb4d7-1f54-4876-9b35-407328e59521 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:48.482739 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d1cdb4d7-1f54-4876-9b35-407328e59521 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:48.571537 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:24:48.572103 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:24:48.572584 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:24:48.572989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:24:48.573402 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:24:48.582092 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:48.582539 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:48.583367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:48.583803 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:48.600444 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Getting quotas for project a4c6bc5f81ac457dbb91c5bc1a8f0d61. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:24:48.605424 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Getting quotas for user 937a7097c9d84402882f73082cfa408f and project a4c6bc5f81ac457dbb91c5bc1a8f0d61. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:24:48.625131 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:24:48.627587 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:24:48.675829 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-601f02e5-2d86-4af5-a927-977ac6c85c1e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674686 Jul 27 04:24:48.677113 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 152/314] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:24:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:24:48.688896 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-05189f4a-1f36-4830-8197-e44afb53330c tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:48.691326 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-05189f4a-1f36-4830-8197-e44afb53330c tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:48.723199 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d1cdb4d7-1f54-4876-9b35-407328e59521 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:48.736590 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d1cdb4d7-1f54-4876-9b35-407328e59521 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.292568 Jul 27 04:24:48.738445 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 163/315] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:48 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:48.756790 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-05189f4a-1f36-4830-8197-e44afb53330c tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:48.764257 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-05189f4a-1f36-4830-8197-e44afb53330c tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1218 microversion: 2.1 time: 0.079934 Jul 27 04:24:48.766025 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 153/316] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:48 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:48.934496 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c0f8bc29-9f91-4193-93e4-faca7df337fe tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:48.935299 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c0f8bc29-9f91-4193-93e4-faca7df337fe tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:48.941669 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c0f8bc29-9f91-4193-93e4-faca7df337fe tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:48.942181 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c0f8bc29-9f91-4193-93e4-faca7df337fe tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:48.942971 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c0f8bc29-9f91-4193-93e4-faca7df337fe tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:48.943410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c0f8bc29-9f91-4193-93e4-faca7df337fe tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:49.223383 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-c0f8bc29-9f91-4193-93e4-faca7df337fe tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:49.230950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c0f8bc29-9f91-4193-93e4-faca7df337fe tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.300416 Jul 27 04:24:49.231508 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 164/317] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:48 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:49.758801 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-608c05c4-a0e2-44bc-ac5c-c044bb5af054 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:49.759540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-608c05c4-a0e2-44bc-ac5c-c044bb5af054 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:49.766025 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-608c05c4-a0e2-44bc-ac5c-c044bb5af054 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:49.766465 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-608c05c4-a0e2-44bc-ac5c-c044bb5af054 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:49.767215 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-608c05c4-a0e2-44bc-ac5c-c044bb5af054 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:49.767640 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-608c05c4-a0e2-44bc-ac5c-c044bb5af054 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:49.784911 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3e8e4f12-44a6-4597-817b-d3ee1f7796b8 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:49.785607 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3e8e4f12-44a6-4597-817b-d3ee1f7796b8 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:49.793068 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3e8e4f12-44a6-4597-817b-d3ee1f7796b8 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:49.793521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3e8e4f12-44a6-4597-817b-d3ee1f7796b8 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:49.794316 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3e8e4f12-44a6-4597-817b-d3ee1f7796b8 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:49.794752 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3e8e4f12-44a6-4597-817b-d3ee1f7796b8 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:49.860041 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3e8e4f12-44a6-4597-817b-d3ee1f7796b8 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:49.867368 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3e8e4f12-44a6-4597-817b-d3ee1f7796b8 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1222 microversion: 2.1 time: 0.086332 Jul 27 04:24:49.868784 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 165/318] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:49 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:24:49.903046 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-608c05c4-a0e2-44bc-ac5c-c044bb5af054 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:49.910442 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-608c05c4-a0e2-44bc-ac5c-c044bb5af054 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.155672 Jul 27 04:24:49.911011 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 154/319] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:49 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:50.252239 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-bc88a0f7-aecf-4176-84dc-658a1c5b502e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:50.252863 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-bc88a0f7-aecf-4176-84dc-658a1c5b502e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:50.254932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:50.261366 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc88a0f7-aecf-4176-84dc-658a1c5b502e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:50.262023 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc88a0f7-aecf-4176-84dc-658a1c5b502e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:50.262851 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc88a0f7-aecf-4176-84dc-658a1c5b502e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:50.263290 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc88a0f7-aecf-4176-84dc-658a1c5b502e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:50.496609 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-bc88a0f7-aecf-4176-84dc-658a1c5b502e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:50.509183 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-bc88a0f7-aecf-4176-84dc-658a1c5b502e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.260868 Jul 27 04:24:50.510095 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 166/320] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:50 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:50.890048 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9a28c388-0d84-4711-b71c-49c452176cff tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:50.890787 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9a28c388-0d84-4711-b71c-49c452176cff tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:50.898887 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9a28c388-0d84-4711-b71c-49c452176cff tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:50.900009 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9a28c388-0d84-4711-b71c-49c452176cff tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:50.900829 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9a28c388-0d84-4711-b71c-49c452176cff tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:50.901264 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9a28c388-0d84-4711-b71c-49c452176cff tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:50.932149 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-2930a338-cb5d-4635-9a24-a849bc4382fc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:50.933519 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-2930a338-cb5d-4635-9a24-a849bc4382fc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:50.940536 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2930a338-cb5d-4635-9a24-a849bc4382fc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:50.941348 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2930a338-cb5d-4635-9a24-a849bc4382fc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:50.942396 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2930a338-cb5d-4635-9a24-a849bc4382fc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:50.943061 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2930a338-cb5d-4635-9a24-a849bc4382fc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:50.987113 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9a28c388-0d84-4711-b71c-49c452176cff tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:50.995274 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9a28c388-0d84-4711-b71c-49c452176cff tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1278 microversion: 2.1 time: 0.109542 Jul 27 04:24:50.998491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 155/321] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:50 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1278 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:24:51.171462 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-2930a338-cb5d-4635-9a24-a849bc4382fc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:51.178878 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-2930a338-cb5d-4635-9a24-a849bc4382fc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.251055 Jul 27 04:24:51.179626 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 167/322] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:50 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:51.531890 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e3aad269-837c-47e3-be26-d69e4bf93f3d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:51.532856 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e3aad269-837c-47e3-be26-d69e4bf93f3d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:51.535141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:51.541946 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e3aad269-837c-47e3-be26-d69e4bf93f3d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:51.542703 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e3aad269-837c-47e3-be26-d69e4bf93f3d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:51.543792 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e3aad269-837c-47e3-be26-d69e4bf93f3d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:51.544421 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e3aad269-837c-47e3-be26-d69e4bf93f3d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:51.695001 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e3aad269-837c-47e3-be26-d69e4bf93f3d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:51.703402 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e3aad269-837c-47e3-be26-d69e4bf93f3d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.175843 Jul 27 04:24:51.706019 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 156/323] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:51 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:52.016784 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-889833b2-f31f-4341-b791-68965979e20d tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:52.017484 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-889833b2-f31f-4341-b791-68965979e20d tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:52.025190 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-889833b2-f31f-4341-b791-68965979e20d tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:52.025735 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-889833b2-f31f-4341-b791-68965979e20d tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:52.026746 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-889833b2-f31f-4341-b791-68965979e20d tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:52.027427 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-889833b2-f31f-4341-b791-68965979e20d tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:52.031654 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=8 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:52.199903 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5d28cbec-fb08-4779-96b8-c4e8cf5ae598 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:52.200629 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-5d28cbec-fb08-4779-96b8-c4e8cf5ae598 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:52.206701 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5d28cbec-fb08-4779-96b8-c4e8cf5ae598 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:52.207141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5d28cbec-fb08-4779-96b8-c4e8cf5ae598 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:52.207894 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5d28cbec-fb08-4779-96b8-c4e8cf5ae598 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:52.208478 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5d28cbec-fb08-4779-96b8-c4e8cf5ae598 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:52.235382 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-889833b2-f31f-4341-b791-68965979e20d tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:52.247420 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-889833b2-f31f-4341-b791-68965979e20d tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1318 microversion: 2.1 time: 0.234571 Jul 27 04:24:52.248193 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 168/324] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:52 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:52.331496 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-028f4cfb-4e6a-4153-aa36-01a31d9dd2c4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:52.332171 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-028f4cfb-4e6a-4153-aa36-01a31d9dd2c4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:52.340076 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-028f4cfb-4e6a-4153-aa36-01a31d9dd2c4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:52.340680 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-028f4cfb-4e6a-4153-aa36-01a31d9dd2c4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:52.341569 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-028f4cfb-4e6a-4153-aa36-01a31d9dd2c4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:52.342170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-028f4cfb-4e6a-4153-aa36-01a31d9dd2c4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:52.360400 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-5d28cbec-fb08-4779-96b8-c4e8cf5ae598 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:52.366803 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-028f4cfb-4e6a-4153-aa36-01a31d9dd2c4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/ips" status: 200 len: 151 microversion: 2.20 time: 0.038967 Jul 27 04:24:52.368159 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 169/325] 10.222.0.46 () {60 vars in 1289 bytes} [Wed Jul 27 04:24:52 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:24:52.373125 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-47d01f83-7b36-425f-91d4-267a8da0ee00 req-833e1233-5d8d-4757-8591-c75ec211adf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34ccad8-647b-4f91-8817-afd14795fc48", "tag": "e26e4869-2678-4ad7-9013-275bf65dd342"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:52.379035 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-5d28cbec-fb08-4779-96b8-c4e8cf5ae598 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.181854 Jul 27 04:24:52.381000 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 157/326] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:52 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:24:52.385425 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-47d01f83-7b36-425f-91d4-267a8da0ee00 req-833e1233-5d8d-4757-8591-c75ec211adf6 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:52.385996 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-47d01f83-7b36-425f-91d4-267a8da0ee00 req-833e1233-5d8d-4757-8591-c75ec211adf6 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:52.397698 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-47d01f83-7b36-425f-91d4-267a8da0ee00 req-833e1233-5d8d-4757-8591-c75ec211adf6 service nova] Creating event network-changed:e26e4869-2678-4ad7-9013-275bf65dd342 for instance d34ccad8-647b-4f91-8817-afd14795fc48 on hv-cinder-85098 Jul 27 04:24:52.403333 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-47d01f83-7b36-425f-91d4-267a8da0ee00 req-833e1233-5d8d-4757-8591-c75ec211adf6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033715 Jul 27 04:24:52.404145 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 170/327] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:24:52.725803 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-fad06657-1f4c-4165-a8dd-521e8f94f901 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:52.726449 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-fad06657-1f4c-4165-a8dd-521e8f94f901 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:52.732716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fad06657-1f4c-4165-a8dd-521e8f94f901 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:52.733166 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fad06657-1f4c-4165-a8dd-521e8f94f901 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:52.733927 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fad06657-1f4c-4165-a8dd-521e8f94f901 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:52.734389 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fad06657-1f4c-4165-a8dd-521e8f94f901 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:52.869471 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-fad06657-1f4c-4165-a8dd-521e8f94f901 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:52.876843 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-fad06657-1f4c-4165-a8dd-521e8f94f901 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.156035 Jul 27 04:24:52.877408 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 158/328] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:52 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:53.268783 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7fa14edd-13bf-4d70-9534-74c98a9c10cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:53.269475 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-7fa14edd-13bf-4d70-9534-74c98a9c10cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:53.276486 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7fa14edd-13bf-4d70-9534-74c98a9c10cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:53.276933 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7fa14edd-13bf-4d70-9534-74c98a9c10cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:53.277684 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7fa14edd-13bf-4d70-9534-74c98a9c10cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:53.278149 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7fa14edd-13bf-4d70-9534-74c98a9c10cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:53.402558 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-61a2d629-e9e0-4361-b56b-3d11b1108a96 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:53.403381 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-61a2d629-e9e0-4361-b56b-3d11b1108a96 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:53.409348 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-61a2d629-e9e0-4361-b56b-3d11b1108a96 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:53.409801 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-61a2d629-e9e0-4361-b56b-3d11b1108a96 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:53.410597 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-61a2d629-e9e0-4361-b56b-3d11b1108a96 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:53.411060 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-61a2d629-e9e0-4361-b56b-3d11b1108a96 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:53.415586 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-7fa14edd-13bf-4d70-9534-74c98a9c10cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:53.422928 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-7fa14edd-13bf-4d70-9534-74c98a9c10cf tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1318 microversion: 2.1 time: 0.158801 Jul 27 04:24:53.423511 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 171/329] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:53 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:53.540153 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-61a2d629-e9e0-4361-b56b-3d11b1108a96 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:53.547559 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-61a2d629-e9e0-4361-b56b-3d11b1108a96 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.149569 Jul 27 04:24:53.548134 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 159/330] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:53 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:24:53.695218 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-04645713-27af-440c-aeb0-d4c5e7da4384 req-99d4f0bd-60e2-4631-aa23-511ad8dab623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5496cce3-6266-4650-84ba-9e01e99cbea6", "name": "network-vif-plugged", "status": "completed", "tag": "69fb12ed-2ec4-4ba8-a2dd-7b56427bd104"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:53.706569 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-04645713-27af-440c-aeb0-d4c5e7da4384 req-99d4f0bd-60e2-4631-aa23-511ad8dab623 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:53.707231 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-04645713-27af-440c-aeb0-d4c5e7da4384 req-99d4f0bd-60e2-4631-aa23-511ad8dab623 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:53.721289 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-04645713-27af-440c-aeb0-d4c5e7da4384 req-99d4f0bd-60e2-4631-aa23-511ad8dab623 service nova] Creating event network-vif-plugged:69fb12ed-2ec4-4ba8-a2dd-7b56427bd104 for instance 5496cce3-6266-4650-84ba-9e01e99cbea6 on hv-cinder-85098 Jul 27 04:24:53.726300 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-04645713-27af-440c-aeb0-d4c5e7da4384 req-99d4f0bd-60e2-4631-aa23-511ad8dab623 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034827 Jul 27 04:24:53.726950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 172/331] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:24:53.896831 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d64d3fe4-e8d0-46ef-bfc6-d029bf54b9f4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:53.897749 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d64d3fe4-e8d0-46ef-bfc6-d029bf54b9f4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:53.905317 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d64d3fe4-e8d0-46ef-bfc6-d029bf54b9f4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:53.905833 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d64d3fe4-e8d0-46ef-bfc6-d029bf54b9f4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:53.906734 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d64d3fe4-e8d0-46ef-bfc6-d029bf54b9f4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:53.907166 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d64d3fe4-e8d0-46ef-bfc6-d029bf54b9f4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:54.046009 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d64d3fe4-e8d0-46ef-bfc6-d029bf54b9f4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:54.053691 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d64d3fe4-e8d0-46ef-bfc6-d029bf54b9f4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.160738 Jul 27 04:24:54.054390 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 160/332] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:53 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:54.435606 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-28ae9227-1c25-4692-b270-e1c0b50c29bc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:54.436129 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-28ae9227-1c25-4692-b270-e1c0b50c29bc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:54.442840 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28ae9227-1c25-4692-b270-e1c0b50c29bc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:54.443284 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28ae9227-1c25-4692-b270-e1c0b50c29bc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:54.443501 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ab29238f-8d63-4961-a73b-5fccddc7f1c9 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:54.444052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28ae9227-1c25-4692-b270-e1c0b50c29bc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:54.444163 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ab29238f-8d63-4961-a73b-5fccddc7f1c9 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:54.444483 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28ae9227-1c25-4692-b270-e1c0b50c29bc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:54.453306 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ab29238f-8d63-4961-a73b-5fccddc7f1c9 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:54.453306 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ab29238f-8d63-4961-a73b-5fccddc7f1c9 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:54.453306 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ab29238f-8d63-4961-a73b-5fccddc7f1c9 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:54.453306 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ab29238f-8d63-4961-a73b-5fccddc7f1c9 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:54.468159 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-28ae9227-1c25-4692-b270-e1c0b50c29bc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lazy-loading 'flavor' on Instance uuid 9478c2cb-a66c-4485-91bf-fe8486025afe {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:24:54.605887 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ab29238f-8d63-4961-a73b-5fccddc7f1c9 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:54.613997 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ab29238f-8d63-4961-a73b-5fccddc7f1c9 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1318 microversion: 2.1 time: 0.174315 Jul 27 04:24:54.614685 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 161/333] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:54 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:54.619634 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4b6c0917-a253-4054-829c-f8d660a6557b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:54.620716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4b6c0917-a253-4054-829c-f8d660a6557b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:54.650348 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4b6c0917-a253-4054-829c-f8d660a6557b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:54.650802 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4b6c0917-a253-4054-829c-f8d660a6557b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:54.651774 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4b6c0917-a253-4054-829c-f8d660a6557b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:54.652229 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4b6c0917-a253-4054-829c-f8d660a6557b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:54.683894 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-28ae9227-1c25-4692-b270-e1c0b50c29bc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "POST /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/action" status: 202 len: 0 microversion: 2.20 time: 0.253289 Jul 27 04:24:54.684491 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 173/334] 10.222.0.46 () {62 vars in 1319 bytes} [Wed Jul 27 04:24:54 2022] POST /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:24:54.698536 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-26c38e3b-77df-401a-acfb-f463b3bcf2ca tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:54.699157 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-26c38e3b-77df-401a-acfb-f463b3bcf2ca tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:54.705367 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-26c38e3b-77df-401a-acfb-f463b3bcf2ca tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:54.705813 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-26c38e3b-77df-401a-acfb-f463b3bcf2ca tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:54.706612 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-26c38e3b-77df-401a-acfb-f463b3bcf2ca tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:54.707041 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-26c38e3b-77df-401a-acfb-f463b3bcf2ca tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:54.790237 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4b6c0917-a253-4054-829c-f8d660a6557b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:54.798289 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4b6c0917-a253-4054-829c-f8d660a6557b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.182381 Jul 27 04:24:54.798855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 162/335] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:54 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:54.842766 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-26c38e3b-77df-401a-acfb-f463b3bcf2ca tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:54.850545 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-26c38e3b-77df-401a-acfb-f463b3bcf2ca tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:54.852769 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-26c38e3b-77df-401a-acfb-f463b3bcf2ca tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:54.853926 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-26c38e3b-77df-401a-acfb-f463b3bcf2ca tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.161692 Jul 27 04:24:54.854650 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 174/336] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:24:54 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:24:55.075238 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-81fc89e2-4290-4e0f-800b-276ee0ea3024 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:55.075804 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-81fc89e2-4290-4e0f-800b-276ee0ea3024 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:55.081701 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-81fc89e2-4290-4e0f-800b-276ee0ea3024 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:55.082215 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-81fc89e2-4290-4e0f-800b-276ee0ea3024 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:55.082978 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-81fc89e2-4290-4e0f-800b-276ee0ea3024 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:55.083415 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-81fc89e2-4290-4e0f-800b-276ee0ea3024 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:55.216670 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-81fc89e2-4290-4e0f-800b-276ee0ea3024 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:55.224023 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-81fc89e2-4290-4e0f-800b-276ee0ea3024 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.153428 Jul 27 04:24:55.224574 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 163/337] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:55 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:55.635270 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-012aaa25-4af6-4bb3-b380-9d4aa9d527c2 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:55.635926 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-012aaa25-4af6-4bb3-b380-9d4aa9d527c2 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:55.642925 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-012aaa25-4af6-4bb3-b380-9d4aa9d527c2 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:55.643388 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-012aaa25-4af6-4bb3-b380-9d4aa9d527c2 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:55.644166 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-012aaa25-4af6-4bb3-b380-9d4aa9d527c2 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:55.644610 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-012aaa25-4af6-4bb3-b380-9d4aa9d527c2 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:55.780699 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-012aaa25-4af6-4bb3-b380-9d4aa9d527c2 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:55.788575 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-012aaa25-4af6-4bb3-b380-9d4aa9d527c2 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1318 microversion: 2.1 time: 0.157145 Jul 27 04:24:55.789163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 175/338] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:55 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:55.818050 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c6eb4b2c-bb8c-4dcd-8594-34294db4bf30 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:55.818651 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c6eb4b2c-bb8c-4dcd-8594-34294db4bf30 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:55.825334 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c6eb4b2c-bb8c-4dcd-8594-34294db4bf30 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:55.825778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c6eb4b2c-bb8c-4dcd-8594-34294db4bf30 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:55.826550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c6eb4b2c-bb8c-4dcd-8594-34294db4bf30 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:55.826974 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c6eb4b2c-bb8c-4dcd-8594-34294db4bf30 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:55.877048 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e37cf23c-9cea-42f3-b24b-bce334a87b2d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:55.877660 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e37cf23c-9cea-42f3-b24b-bce334a87b2d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:55.884260 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e37cf23c-9cea-42f3-b24b-bce334a87b2d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:55.884849 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e37cf23c-9cea-42f3-b24b-bce334a87b2d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:55.885630 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e37cf23c-9cea-42f3-b24b-bce334a87b2d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:55.886098 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e37cf23c-9cea-42f3-b24b-bce334a87b2d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:55.955054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c6eb4b2c-bb8c-4dcd-8594-34294db4bf30 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:55.963278 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c6eb4b2c-bb8c-4dcd-8594-34294db4bf30 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1259 microversion: 2.1 time: 0.148879 Jul 27 04:24:55.967733 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 164/339] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:55 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:56.024507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e37cf23c-9cea-42f3-b24b-bce334a87b2d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:56.032532 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e37cf23c-9cea-42f3-b24b-bce334a87b2d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:56.034158 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e37cf23c-9cea-42f3-b24b-bce334a87b2d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:56.035299 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e37cf23c-9cea-42f3-b24b-bce334a87b2d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.162510 Jul 27 04:24:56.035854 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 176/340] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:24:55 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:24:56.245640 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-36fa3571-508c-498a-a470-ef1b1dac58a6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:56.246301 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-36fa3571-508c-498a-a470-ef1b1dac58a6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:56.252191 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-36fa3571-508c-498a-a470-ef1b1dac58a6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:56.252635 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-36fa3571-508c-498a-a470-ef1b1dac58a6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:56.253395 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-36fa3571-508c-498a-a470-ef1b1dac58a6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:56.253829 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-36fa3571-508c-498a-a470-ef1b1dac58a6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:56.387194 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-36fa3571-508c-498a-a470-ef1b1dac58a6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:56.394649 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-36fa3571-508c-498a-a470-ef1b1dac58a6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.154152 Jul 27 04:24:56.395211 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 165/341] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:56 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:56.810284 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e8528f05-3f6b-475b-a59b-e18e9a0c5a42 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:56.810898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e8528f05-3f6b-475b-a59b-e18e9a0c5a42 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:56.817376 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e8528f05-3f6b-475b-a59b-e18e9a0c5a42 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:56.817828 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e8528f05-3f6b-475b-a59b-e18e9a0c5a42 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:56.818624 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e8528f05-3f6b-475b-a59b-e18e9a0c5a42 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:56.819063 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e8528f05-3f6b-475b-a59b-e18e9a0c5a42 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:56.952551 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e8528f05-3f6b-475b-a59b-e18e9a0c5a42 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:56.954928 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:56.961176 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e8528f05-3f6b-475b-a59b-e18e9a0c5a42 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1318 microversion: 2.1 time: 0.154767 Jul 27 04:24:56.961823 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 177/342] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:56 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:56.984368 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4b7963b9-2c2f-452d-b6a7-5673a7a5918b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:56.984971 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4b7963b9-2c2f-452d-b6a7-5673a7a5918b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:56.990877 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4b7963b9-2c2f-452d-b6a7-5673a7a5918b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:56.991313 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4b7963b9-2c2f-452d-b6a7-5673a7a5918b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:56.992056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4b7963b9-2c2f-452d-b6a7-5673a7a5918b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:56.992976 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4b7963b9-2c2f-452d-b6a7-5673a7a5918b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:57.007526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=100 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:57.058950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a6573f61-23d1-411b-88e9-94f3451a3c81 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:57.059565 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a6573f61-23d1-411b-88e9-94f3451a3c81 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:57.066617 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a6573f61-23d1-411b-88e9-94f3451a3c81 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:57.067067 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a6573f61-23d1-411b-88e9-94f3451a3c81 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:57.067844 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a6573f61-23d1-411b-88e9-94f3451a3c81 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:57.068283 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a6573f61-23d1-411b-88e9-94f3451a3c81 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:57.125548 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4b7963b9-2c2f-452d-b6a7-5673a7a5918b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:57.134071 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4b7963b9-2c2f-452d-b6a7-5673a7a5918b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1442 microversion: 2.1 time: 0.152738 Jul 27 04:24:57.134772 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 166/343] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:56 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:57.155198 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5e5ed8c7-62f2-44d7-bdd0-10ecab76f091 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:57.155737 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-5e5ed8c7-62f2-44d7-bdd0-10ecab76f091 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:57.161670 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5e5ed8c7-62f2-44d7-bdd0-10ecab76f091 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:57.162150 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5e5ed8c7-62f2-44d7-bdd0-10ecab76f091 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:57.162906 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5e5ed8c7-62f2-44d7-bdd0-10ecab76f091 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:57.163340 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5e5ed8c7-62f2-44d7-bdd0-10ecab76f091 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:57.202221 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a6573f61-23d1-411b-88e9-94f3451a3c81 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:57.210136 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a6573f61-23d1-411b-88e9-94f3451a3c81 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:57.211843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a6573f61-23d1-411b-88e9-94f3451a3c81 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:57.213000 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a6573f61-23d1-411b-88e9-94f3451a3c81 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.158793 Jul 27 04:24:57.213554 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 178/344] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:24:57 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:24:57.292057 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-5e5ed8c7-62f2-44d7-bdd0-10ecab76f091 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:57.299563 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-5e5ed8c7-62f2-44d7-bdd0-10ecab76f091 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1442 microversion: 2.1 time: 0.148158 Jul 27 04:24:57.300125 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 167/345] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:57 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1442 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:24:57.415360 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d6c717ab-e805-4629-ac5a-6885deb59757 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:57.415926 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d6c717ab-e805-4629-ac5a-6885deb59757 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:57.421804 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d6c717ab-e805-4629-ac5a-6885deb59757 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:57.422286 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d6c717ab-e805-4629-ac5a-6885deb59757 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:57.423051 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d6c717ab-e805-4629-ac5a-6885deb59757 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:57.423484 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d6c717ab-e805-4629-ac5a-6885deb59757 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:57.563781 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d6c717ab-e805-4629-ac5a-6885deb59757 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:57.572379 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d6c717ab-e805-4629-ac5a-6885deb59757 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.161229 Jul 27 04:24:57.573135 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 179/346] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:57 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:57.884152 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-4cac7dcd-d676-4a66-a10d-ae647bce41d6 req-68e415f3-be26-4680-a8c4-1203584ec1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34ccad8-647b-4f91-8817-afd14795fc48", "name": "network-vif-plugged", "status": "completed", "tag": "e26e4869-2678-4ad7-9013-275bf65dd342"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:57.894360 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-4cac7dcd-d676-4a66-a10d-ae647bce41d6 req-68e415f3-be26-4680-a8c4-1203584ec1f3 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:57.894930 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-4cac7dcd-d676-4a66-a10d-ae647bce41d6 req-68e415f3-be26-4680-a8c4-1203584ec1f3 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:57.909033 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-4cac7dcd-d676-4a66-a10d-ae647bce41d6 req-68e415f3-be26-4680-a8c4-1203584ec1f3 service nova] Creating event network-vif-plugged:e26e4869-2678-4ad7-9013-275bf65dd342 for instance d34ccad8-647b-4f91-8817-afd14795fc48 on hv-cinder-85098 Jul 27 04:24:57.914065 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-4cac7dcd-d676-4a66-a10d-ae647bce41d6 req-68e415f3-be26-4680-a8c4-1203584ec1f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034786 Jul 27 04:24:57.915165 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 168/347] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:24:57.981645 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-6e0a394f-6e78-46e4-ad73-5d82dd89a247 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:57.982337 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-6e0a394f-6e78-46e4-ad73-5d82dd89a247 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:58.000501 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6e0a394f-6e78-46e4-ad73-5d82dd89a247 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:58.001346 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6e0a394f-6e78-46e4-ad73-5d82dd89a247 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:58.002392 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6e0a394f-6e78-46e4-ad73-5d82dd89a247 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:58.003001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6e0a394f-6e78-46e4-ad73-5d82dd89a247 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:58.186032 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-6e0a394f-6e78-46e4-ad73-5d82dd89a247 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:58.194722 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-6e0a394f-6e78-46e4-ad73-5d82dd89a247 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1318 microversion: 2.1 time: 0.216783 Jul 27 04:24:58.208375 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 180/348] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:57 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:58.236518 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-714f3290-ccea-464f-9b96-c6d1f2d2c609 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:58.237374 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-714f3290-ccea-464f-9b96-c6d1f2d2c609 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:58.244354 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-714f3290-ccea-464f-9b96-c6d1f2d2c609 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:58.244800 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-714f3290-ccea-464f-9b96-c6d1f2d2c609 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:58.245569 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-714f3290-ccea-464f-9b96-c6d1f2d2c609 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:58.246023 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-714f3290-ccea-464f-9b96-c6d1f2d2c609 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:58.591767 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=4 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:58.593876 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-dcc103fd-bc86-42a4-8155-61de5bb758a7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:58.595194 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-dcc103fd-bc86-42a4-8155-61de5bb758a7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:58.604317 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dcc103fd-bc86-42a4-8155-61de5bb758a7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:58.605132 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dcc103fd-bc86-42a4-8155-61de5bb758a7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:58.606519 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dcc103fd-bc86-42a4-8155-61de5bb758a7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:58.607138 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dcc103fd-bc86-42a4-8155-61de5bb758a7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:58.712736 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-714f3290-ccea-464f-9b96-c6d1f2d2c609 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:58.725450 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-714f3290-ccea-464f-9b96-c6d1f2d2c609 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:58.728473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-714f3290-ccea-464f-9b96-c6d1f2d2c609 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:58.730811 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-714f3290-ccea-464f-9b96-c6d1f2d2c609 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.497874 Jul 27 04:24:58.738548 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 169/349] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:24:58 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:24:58.770784 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-dcc103fd-bc86-42a4-8155-61de5bb758a7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:58.779603 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-dcc103fd-bc86-42a4-8155-61de5bb758a7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.190170 Jul 27 04:24:58.780366 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 181/350] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:58 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:24:59.216537 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-71d0d576-c248-420b-89cf-630e3ad9935c tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:59.217050 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-71d0d576-c248-420b-89cf-630e3ad9935c tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:59.218976 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=16 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:59.224204 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-71d0d576-c248-420b-89cf-630e3ad9935c tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:59.224647 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-71d0d576-c248-420b-89cf-630e3ad9935c tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:59.225394 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-71d0d576-c248-420b-89cf-630e3ad9935c tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:59.225820 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-71d0d576-c248-420b-89cf-630e3ad9935c tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:59.435011 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-71d0d576-c248-420b-89cf-630e3ad9935c tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:59.443403 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-71d0d576-c248-420b-89cf-630e3ad9935c tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1318 microversion: 2.1 time: 0.230722 Jul 27 04:24:59.444220 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 170/351] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:59 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:24:59.478236 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-c61d8ecd-8a8d-4b4c-8ade-2cb34adf3647 req-e30fa251-be59-43fe-841c-a781a481d199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5496cce3-6266-4650-84ba-9e01e99cbea6", "tag": "69fb12ed-2ec4-4ba8-a2dd-7b56427bd104"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:24:59.488099 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-c61d8ecd-8a8d-4b4c-8ade-2cb34adf3647 req-e30fa251-be59-43fe-841c-a781a481d199 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:59.488535 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-c61d8ecd-8a8d-4b4c-8ade-2cb34adf3647 req-e30fa251-be59-43fe-841c-a781a481d199 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:59.499332 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-c61d8ecd-8a8d-4b4c-8ade-2cb34adf3647 req-e30fa251-be59-43fe-841c-a781a481d199 service nova] Creating event network-changed:69fb12ed-2ec4-4ba8-a2dd-7b56427bd104 for instance 5496cce3-6266-4650-84ba-9e01e99cbea6 on hv-cinder-85098 Jul 27 04:24:59.504267 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-c61d8ecd-8a8d-4b4c-8ade-2cb34adf3647 req-e30fa251-be59-43fe-841c-a781a481d199 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030501 Jul 27 04:24:59.505038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 182/352] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:24:59.753253 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-94a26856-525e-4c26-a660-9eee84af9972 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:59.753905 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-94a26856-525e-4c26-a660-9eee84af9972 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:59.761137 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-94a26856-525e-4c26-a660-9eee84af9972 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:59.761580 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-94a26856-525e-4c26-a660-9eee84af9972 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:59.762369 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-94a26856-525e-4c26-a660-9eee84af9972 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:59.762795 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-94a26856-525e-4c26-a660-9eee84af9972 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:59.801270 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0f009dce-9cd3-4588-b609-294ee9c76911 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:24:59.801961 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0f009dce-9cd3-4588-b609-294ee9c76911 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:24:59.810146 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0f009dce-9cd3-4588-b609-294ee9c76911 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:59.810597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0f009dce-9cd3-4588-b609-294ee9c76911 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:59.811370 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0f009dce-9cd3-4588-b609-294ee9c76911 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:24:59.811798 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0f009dce-9cd3-4588-b609-294ee9c76911 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:24:59.906819 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-94a26856-525e-4c26-a660-9eee84af9972 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:59.916024 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-94a26856-525e-4c26-a660-9eee84af9972 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:59.917514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-94a26856-525e-4c26-a660-9eee84af9972 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:59.918920 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-94a26856-525e-4c26-a660-9eee84af9972 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.169808 Jul 27 04:24:59.919641 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 171/353] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:24:59 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:24:59.971073 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0f009dce-9cd3-4588-b609-294ee9c76911 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:24:59.988626 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0f009dce-9cd3-4588-b609-294ee9c76911 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.183791 Jul 27 04:24:59.991399 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 183/354] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:24:59 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:00.054764 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-189333e8-0a6d-4dd3-b6e6-f817b679f551 req-7f01310a-ea3a-49cf-8b3c-3b94b354a786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1dc2957-3830-46b6-b50c-05806cb4e259", "name": "network-vif-plugged", "status": "completed", "tag": "c8fba684-60c7-4ea8-891e-bf8550d838f9"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:25:00.064834 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-189333e8-0a6d-4dd3-b6e6-f817b679f551 req-7f01310a-ea3a-49cf-8b3c-3b94b354a786 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:00.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-189333e8-0a6d-4dd3-b6e6-f817b679f551 req-7f01310a-ea3a-49cf-8b3c-3b94b354a786 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:00.215381 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-189333e8-0a6d-4dd3-b6e6-f817b679f551 req-7f01310a-ea3a-49cf-8b3c-3b94b354a786 service nova] Creating event network-vif-plugged:c8fba684-60c7-4ea8-891e-bf8550d838f9 for instance a1dc2957-3830-46b6-b50c-05806cb4e259 on hv-cinder-85098 Jul 27 04:25:00.220264 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-189333e8-0a6d-4dd3-b6e6-f817b679f551 req-7f01310a-ea3a-49cf-8b3c-3b94b354a786 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170260 Jul 27 04:25:00.221263 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 172/355] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:25:00.473945 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d3803861-7cbd-42de-8ea8-68b68d4b998e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:00.474778 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d3803861-7cbd-42de-8ea8-68b68d4b998e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:00.487618 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d3803861-7cbd-42de-8ea8-68b68d4b998e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:00.488379 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d3803861-7cbd-42de-8ea8-68b68d4b998e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:00.488900 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d3803861-7cbd-42de-8ea8-68b68d4b998e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:00.489414 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d3803861-7cbd-42de-8ea8-68b68d4b998e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:00.699895 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d3803861-7cbd-42de-8ea8-68b68d4b998e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:00.707678 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d3803861-7cbd-42de-8ea8-68b68d4b998e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1505 microversion: 2.1 time: 0.246886 Jul 27 04:25:00.708242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 184/356] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:00 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:00.729714 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-053a8949-b0b9-4337-9654-9e967ad76bab tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc4ff93d-3825-43e3-9795-7a7bc94d3a66", "device": "/dev/sdb"}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:25:00.733426 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-053a8949-b0b9-4337-9654-9e967ad76bab tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:00.739818 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-053a8949-b0b9-4337-9654-9e967ad76bab tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:00.740499 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-053a8949-b0b9-4337-9654-9e967ad76bab tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:00.741439 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-053a8949-b0b9-4337-9654-9e967ad76bab tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:00.741859 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-053a8949-b0b9-4337-9654-9e967ad76bab tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:00.942149 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ea780e88-ea47-4e29-a683-6ff9d920563d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:00.942786 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ea780e88-ea47-4e29-a683-6ff9d920563d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:00.949515 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ea780e88-ea47-4e29-a683-6ff9d920563d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:00.949955 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ea780e88-ea47-4e29-a683-6ff9d920563d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:00.951168 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ea780e88-ea47-4e29-a683-6ff9d920563d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:00.951691 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ea780e88-ea47-4e29-a683-6ff9d920563d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:01.018862 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-053a8949-b0b9-4337-9654-9e967ad76bab tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "POST /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294176 Jul 27 04:25:01.025482 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 173/357] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:25:00 2022] POST /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:25:01.025482 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6da263f5-7aa8-4bc1-8606-e15dce34138d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:01.025805 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6da263f5-7aa8-4bc1-8606-e15dce34138d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:01.032374 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6da263f5-7aa8-4bc1-8606-e15dce34138d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:01.032819 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6da263f5-7aa8-4bc1-8606-e15dce34138d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:01.033589 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6da263f5-7aa8-4bc1-8606-e15dce34138d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:01.034042 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6da263f5-7aa8-4bc1-8606-e15dce34138d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:01.093775 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ea780e88-ea47-4e29-a683-6ff9d920563d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:01.101677 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ea780e88-ea47-4e29-a683-6ff9d920563d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:01.103589 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ea780e88-ea47-4e29-a683-6ff9d920563d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:01.104738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ea780e88-ea47-4e29-a683-6ff9d920563d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.166606 Jul 27 04:25:01.105299 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 185/358] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:00 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:25:01.167442 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6da263f5-7aa8-4bc1-8606-e15dce34138d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:01.174850 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6da263f5-7aa8-4bc1-8606-e15dce34138d tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.154176 Jul 27 04:25:01.175403 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 174/359] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:01 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:02.127486 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-bc911602-cd39-47fa-98df-918eecce70ad tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:02.128102 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-bc911602-cd39-47fa-98df-918eecce70ad tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:02.134878 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc911602-cd39-47fa-98df-918eecce70ad tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:02.135890 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc911602-cd39-47fa-98df-918eecce70ad tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:02.136749 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc911602-cd39-47fa-98df-918eecce70ad tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:02.137082 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc911602-cd39-47fa-98df-918eecce70ad tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:02.195392 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-97a3689c-0196-4460-b27a-78c1a970fe7e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:02.196376 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-97a3689c-0196-4460-b27a-78c1a970fe7e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:02.202567 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-97a3689c-0196-4460-b27a-78c1a970fe7e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:02.203006 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-97a3689c-0196-4460-b27a-78c1a970fe7e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:02.203758 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-97a3689c-0196-4460-b27a-78c1a970fe7e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:02.204184 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-97a3689c-0196-4460-b27a-78c1a970fe7e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:02.271959 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-bc911602-cd39-47fa-98df-918eecce70ad tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:02.280624 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-bc911602-cd39-47fa-98df-918eecce70ad tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:02.282164 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-bc911602-cd39-47fa-98df-918eecce70ad tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:02.283332 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-bc911602-cd39-47fa-98df-918eecce70ad tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.159676 Jul 27 04:25:02.283898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 186/360] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:02 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:02.337442 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-97a3689c-0196-4460-b27a-78c1a970fe7e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:02.344963 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-97a3689c-0196-4460-b27a-78c1a970fe7e tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1265 microversion: 2.1 time: 0.153379 Jul 27 04:25:02.345513 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 175/361] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:02 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:25:03.308181 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-95093d0c-09a0-4f2c-a658-3cc25baf45d8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:03.308809 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-95093d0c-09a0-4f2c-a658-3cc25baf45d8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:03.315277 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-95093d0c-09a0-4f2c-a658-3cc25baf45d8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:03.315725 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-95093d0c-09a0-4f2c-a658-3cc25baf45d8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:03.316480 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-95093d0c-09a0-4f2c-a658-3cc25baf45d8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:03.316914 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-95093d0c-09a0-4f2c-a658-3cc25baf45d8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:03.366162 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-a13fcc02-7a6c-452d-b342-8071d920c0d8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:03.366830 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-a13fcc02-7a6c-452d-b342-8071d920c0d8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:03.374060 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a13fcc02-7a6c-452d-b342-8071d920c0d8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:03.374508 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a13fcc02-7a6c-452d-b342-8071d920c0d8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:03.375264 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a13fcc02-7a6c-452d-b342-8071d920c0d8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:03.375700 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a13fcc02-7a6c-452d-b342-8071d920c0d8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:03.448578 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-95093d0c-09a0-4f2c-a658-3cc25baf45d8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:03.457149 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-95093d0c-09a0-4f2c-a658-3cc25baf45d8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:03.458818 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-95093d0c-09a0-4f2c-a658-3cc25baf45d8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:03.460072 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-95093d0c-09a0-4f2c-a658-3cc25baf45d8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.156336 Jul 27 04:25:03.460741 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 187/362] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:03 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:03.509534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-a13fcc02-7a6c-452d-b342-8071d920c0d8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:03.516918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-a13fcc02-7a6c-452d-b342-8071d920c0d8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1451 microversion: 2.1 time: 0.154635 Jul 27 04:25:03.517472 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 176/363] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:03 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:03.536931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d651d757-9718-4471-93a8-baffc61fcb35 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:03.537546 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d651d757-9718-4471-93a8-baffc61fcb35 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:03.544307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d651d757-9718-4471-93a8-baffc61fcb35 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:03.544759 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d651d757-9718-4471-93a8-baffc61fcb35 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:03.545526 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d651d757-9718-4471-93a8-baffc61fcb35 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:03.545962 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d651d757-9718-4471-93a8-baffc61fcb35 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:03.675218 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d651d757-9718-4471-93a8-baffc61fcb35 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:03.683588 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d651d757-9718-4471-93a8-baffc61fcb35 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1451 microversion: 2.1 time: 0.150406 Jul 27 04:25:03.684159 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 188/364] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:03 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:04.483366 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ab9dbe8f-1107-4417-be13-bfda8bff0080 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:04.484000 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ab9dbe8f-1107-4417-be13-bfda8bff0080 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:04.490449 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ab9dbe8f-1107-4417-be13-bfda8bff0080 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:04.490900 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ab9dbe8f-1107-4417-be13-bfda8bff0080 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:04.491667 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ab9dbe8f-1107-4417-be13-bfda8bff0080 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:04.492103 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ab9dbe8f-1107-4417-be13-bfda8bff0080 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:04.627429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ab9dbe8f-1107-4417-be13-bfda8bff0080 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:04.635747 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ab9dbe8f-1107-4417-be13-bfda8bff0080 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:04.637569 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ab9dbe8f-1107-4417-be13-bfda8bff0080 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:04.638785 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ab9dbe8f-1107-4417-be13-bfda8bff0080 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.159420 Jul 27 04:25:04.639335 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 177/365] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:04 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:05.584892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-4bb1b901-7add-4bf5-a425-46242c73844c req-57de78d3-cec4-4e63-b8cc-0243841ca292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1dc2957-3830-46b6-b50c-05806cb4e259", "tag": "c8fba684-60c7-4ea8-891e-bf8550d838f9"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:25:05.595089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-4bb1b901-7add-4bf5-a425-46242c73844c req-57de78d3-cec4-4e63-b8cc-0243841ca292 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:05.595619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-4bb1b901-7add-4bf5-a425-46242c73844c req-57de78d3-cec4-4e63-b8cc-0243841ca292 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:05.607283 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-4bb1b901-7add-4bf5-a425-46242c73844c req-57de78d3-cec4-4e63-b8cc-0243841ca292 service nova] Creating event network-changed:c8fba684-60c7-4ea8-891e-bf8550d838f9 for instance a1dc2957-3830-46b6-b50c-05806cb4e259 on hv-cinder-85098 Jul 27 04:25:05.612265 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-4bb1b901-7add-4bf5-a425-46242c73844c req-57de78d3-cec4-4e63-b8cc-0243841ca292 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031085 Jul 27 04:25:05.612916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 189/366] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:25:05.665180 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f8e736cf-2336-42c4-ac80-a3a02e8d4731 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:05.665701 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f8e736cf-2336-42c4-ac80-a3a02e8d4731 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:05.672108 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f8e736cf-2336-42c4-ac80-a3a02e8d4731 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:05.672485 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f8e736cf-2336-42c4-ac80-a3a02e8d4731 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:05.673241 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f8e736cf-2336-42c4-ac80-a3a02e8d4731 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:05.673664 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f8e736cf-2336-42c4-ac80-a3a02e8d4731 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:05.814398 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f8e736cf-2336-42c4-ac80-a3a02e8d4731 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:05.824500 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f8e736cf-2336-42c4-ac80-a3a02e8d4731 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:05.826107 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f8e736cf-2336-42c4-ac80-a3a02e8d4731 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:05.827259 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f8e736cf-2336-42c4-ac80-a3a02e8d4731 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.168224 Jul 27 04:25:05.827861 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 178/367] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:05 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:06.853482 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-78eba63e-fb16-4e3e-8da3-f81902da0269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:06.854176 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-78eba63e-fb16-4e3e-8da3-f81902da0269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:06.860335 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-78eba63e-fb16-4e3e-8da3-f81902da0269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:06.860783 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-78eba63e-fb16-4e3e-8da3-f81902da0269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:06.861549 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-78eba63e-fb16-4e3e-8da3-f81902da0269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:06.862008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-78eba63e-fb16-4e3e-8da3-f81902da0269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:06.996767 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-78eba63e-fb16-4e3e-8da3-f81902da0269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:07.004592 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-78eba63e-fb16-4e3e-8da3-f81902da0269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:07.006114 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-78eba63e-fb16-4e3e-8da3-f81902da0269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:07.007256 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-78eba63e-fb16-4e3e-8da3-f81902da0269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.159474 Jul 27 04:25:07.007813 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 190/368] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:06 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:08.030352 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-dd162f98-22bc-4b77-a2b6-3d47d0926b8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:08.030959 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-dd162f98-22bc-4b77-a2b6-3d47d0926b8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:08.037235 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-dd162f98-22bc-4b77-a2b6-3d47d0926b8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:08.037677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-dd162f98-22bc-4b77-a2b6-3d47d0926b8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:08.038470 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-dd162f98-22bc-4b77-a2b6-3d47d0926b8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:08.038904 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-dd162f98-22bc-4b77-a2b6-3d47d0926b8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:08.166675 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-dd162f98-22bc-4b77-a2b6-3d47d0926b8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:08.175312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-dd162f98-22bc-4b77-a2b6-3d47d0926b8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:08.176863 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-dd162f98-22bc-4b77-a2b6-3d47d0926b8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:08.178044 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-dd162f98-22bc-4b77-a2b6-3d47d0926b8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.151701 Jul 27 04:25:08.178810 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 179/369] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:08 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:09.201492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d90b782d-93e9-4e3d-99a2-c1e37d9045b9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:09.202119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d90b782d-93e9-4e3d-99a2-c1e37d9045b9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:09.208021 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d90b782d-93e9-4e3d-99a2-c1e37d9045b9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:09.208489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d90b782d-93e9-4e3d-99a2-c1e37d9045b9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:09.209241 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d90b782d-93e9-4e3d-99a2-c1e37d9045b9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:09.209671 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d90b782d-93e9-4e3d-99a2-c1e37d9045b9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:09.335722 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d90b782d-93e9-4e3d-99a2-c1e37d9045b9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:09.344133 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d90b782d-93e9-4e3d-99a2-c1e37d9045b9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:09.345655 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d90b782d-93e9-4e3d-99a2-c1e37d9045b9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:09.346814 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d90b782d-93e9-4e3d-99a2-c1e37d9045b9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.150274 Jul 27 04:25:09.347367 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 191/370] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:09 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:10.369536 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-de5f818f-0fa5-49db-acd5-8d951ad32edf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:10.370181 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-de5f818f-0fa5-49db-acd5-8d951ad32edf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:10.376755 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-de5f818f-0fa5-49db-acd5-8d951ad32edf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:10.377193 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-de5f818f-0fa5-49db-acd5-8d951ad32edf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:10.377941 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-de5f818f-0fa5-49db-acd5-8d951ad32edf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:10.378397 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-de5f818f-0fa5-49db-acd5-8d951ad32edf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:10.504682 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-de5f818f-0fa5-49db-acd5-8d951ad32edf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:10.513731 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-de5f818f-0fa5-49db-acd5-8d951ad32edf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:10.515262 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-de5f818f-0fa5-49db-acd5-8d951ad32edf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:10.516402 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-de5f818f-0fa5-49db-acd5-8d951ad32edf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.150877 Jul 27 04:25:10.516953 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 180/371] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:10 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:11.540018 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f6a2153d-4d0b-470f-b9f6-ee2f03f9b8be tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:11.540846 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f6a2153d-4d0b-470f-b9f6-ee2f03f9b8be tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:11.547310 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f6a2153d-4d0b-470f-b9f6-ee2f03f9b8be tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:11.547750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f6a2153d-4d0b-470f-b9f6-ee2f03f9b8be tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:11.548500 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f6a2153d-4d0b-470f-b9f6-ee2f03f9b8be tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:11.549052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f6a2153d-4d0b-470f-b9f6-ee2f03f9b8be tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:11.678880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f6a2153d-4d0b-470f-b9f6-ee2f03f9b8be tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:11.687198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f6a2153d-4d0b-470f-b9f6-ee2f03f9b8be tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:11.688685 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f6a2153d-4d0b-470f-b9f6-ee2f03f9b8be tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:11.689819 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f6a2153d-4d0b-470f-b9f6-ee2f03f9b8be tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.153679 Jul 27 04:25:11.690403 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 192/372] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:11 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:12.714063 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ae39b441-772f-4aa8-8b24-756652637df1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:12.714612 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ae39b441-772f-4aa8-8b24-756652637df1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:12.721034 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ae39b441-772f-4aa8-8b24-756652637df1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:12.721479 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ae39b441-772f-4aa8-8b24-756652637df1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:12.722292 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ae39b441-772f-4aa8-8b24-756652637df1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:12.722725 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ae39b441-772f-4aa8-8b24-756652637df1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:12.856594 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ae39b441-772f-4aa8-8b24-756652637df1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:12.864424 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ae39b441-772f-4aa8-8b24-756652637df1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:12.865920 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ae39b441-772f-4aa8-8b24-756652637df1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:12.867090 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ae39b441-772f-4aa8-8b24-756652637df1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.157669 Jul 27 04:25:12.867638 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 181/373] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:12 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:13.889674 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-46ff8db8-c91c-438f-9b2e-538b96725269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:13.890306 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-46ff8db8-c91c-438f-9b2e-538b96725269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:13.897431 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-46ff8db8-c91c-438f-9b2e-538b96725269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:13.897874 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-46ff8db8-c91c-438f-9b2e-538b96725269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:13.898692 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-46ff8db8-c91c-438f-9b2e-538b96725269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:13.899162 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-46ff8db8-c91c-438f-9b2e-538b96725269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:14.035404 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-46ff8db8-c91c-438f-9b2e-538b96725269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:14.043388 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-46ff8db8-c91c-438f-9b2e-538b96725269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:14.044886 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-46ff8db8-c91c-438f-9b2e-538b96725269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:14.046079 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-46ff8db8-c91c-438f-9b2e-538b96725269 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1744 microversion: 2.20 time: 0.160224 Jul 27 04:25:14.046644 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 193/374] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:13 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:15.069354 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-01778fcf-ce1c-4567-ba8d-da5b09eed20c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:15.069954 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-01778fcf-ce1c-4567-ba8d-da5b09eed20c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:15.077197 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-01778fcf-ce1c-4567-ba8d-da5b09eed20c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:15.077632 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-01778fcf-ce1c-4567-ba8d-da5b09eed20c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:15.078430 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-01778fcf-ce1c-4567-ba8d-da5b09eed20c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:15.078838 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-01778fcf-ce1c-4567-ba8d-da5b09eed20c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:15.203719 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-01778fcf-ce1c-4567-ba8d-da5b09eed20c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:15.211483 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-01778fcf-ce1c-4567-ba8d-da5b09eed20c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:15.213569 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-01778fcf-ce1c-4567-ba8d-da5b09eed20c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:15.214732 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-01778fcf-ce1c-4567-ba8d-da5b09eed20c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1744 microversion: 2.20 time: 0.149253 Jul 27 04:25:15.215285 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 182/375] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:15 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:16.237952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d0c9999b-7d9d-4ee8-a3fe-b4679d4fc99e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:16.238609 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d0c9999b-7d9d-4ee8-a3fe-b4679d4fc99e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:16.245684 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d0c9999b-7d9d-4ee8-a3fe-b4679d4fc99e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:16.246163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d0c9999b-7d9d-4ee8-a3fe-b4679d4fc99e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:16.246951 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d0c9999b-7d9d-4ee8-a3fe-b4679d4fc99e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:16.247385 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d0c9999b-7d9d-4ee8-a3fe-b4679d4fc99e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:16.381157 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d0c9999b-7d9d-4ee8-a3fe-b4679d4fc99e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:16.389994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d0c9999b-7d9d-4ee8-a3fe-b4679d4fc99e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:16.391514 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d0c9999b-7d9d-4ee8-a3fe-b4679d4fc99e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:16.392668 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d0c9999b-7d9d-4ee8-a3fe-b4679d4fc99e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1744 microversion: 2.20 time: 0.158839 Jul 27 04:25:16.393228 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 194/376] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:16 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:17.416471 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e34f3de1-e8e1-4176-b16e-9406653bba23 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:17.417072 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e34f3de1-e8e1-4176-b16e-9406653bba23 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:17.423484 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e34f3de1-e8e1-4176-b16e-9406653bba23 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:17.423926 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e34f3de1-e8e1-4176-b16e-9406653bba23 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:17.424673 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e34f3de1-e8e1-4176-b16e-9406653bba23 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:17.425101 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e34f3de1-e8e1-4176-b16e-9406653bba23 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:17.429070 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:17.556384 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e34f3de1-e8e1-4176-b16e-9406653bba23 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:17.565131 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e34f3de1-e8e1-4176-b16e-9406653bba23 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:17.566655 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e34f3de1-e8e1-4176-b16e-9406653bba23 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:17.567793 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e34f3de1-e8e1-4176-b16e-9406653bba23 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1744 microversion: 2.20 time: 0.155868 Jul 27 04:25:17.568344 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 183/377] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:17 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:18.592504 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0ec2c917-89db-43fe-b9aa-cd57615d28d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:18.593377 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0ec2c917-89db-43fe-b9aa-cd57615d28d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:18.600367 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0ec2c917-89db-43fe-b9aa-cd57615d28d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:18.600841 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0ec2c917-89db-43fe-b9aa-cd57615d28d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:18.602110 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0ec2c917-89db-43fe-b9aa-cd57615d28d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:18.602597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0ec2c917-89db-43fe-b9aa-cd57615d28d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:18.674662 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-3166d796-f7c8-45c5-8b5b-f10b619df55a req-ba6c939c-a7d4-4f4c-bae3-45efab751237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9478c2cb-a66c-4485-91bf-fe8486025afe", "name": "network-vif-plugged", "status": "completed", "tag": "d905ab8e-bb09-45aa-9436-9f67042c2d1a"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:25:18.698254 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-3166d796-f7c8-45c5-8b5b-f10b619df55a req-ba6c939c-a7d4-4f4c-bae3-45efab751237 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:18.699035 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-3166d796-f7c8-45c5-8b5b-f10b619df55a req-ba6c939c-a7d4-4f4c-bae3-45efab751237 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:18.712673 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-3166d796-f7c8-45c5-8b5b-f10b619df55a req-ba6c939c-a7d4-4f4c-bae3-45efab751237 service nova] Creating event network-vif-plugged:d905ab8e-bb09-45aa-9436-9f67042c2d1a for instance 9478c2cb-a66c-4485-91bf-fe8486025afe on hv-cinder-85098 Jul 27 04:25:18.728039 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-3166d796-f7c8-45c5-8b5b-f10b619df55a req-ba6c939c-a7d4-4f4c-bae3-45efab751237 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051024 Jul 27 04:25:18.729833 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 184/378] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:25:18.782280 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0ec2c917-89db-43fe-b9aa-cd57615d28d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:18.788085 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=100 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:18.792550 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0ec2c917-89db-43fe-b9aa-cd57615d28d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:18.794518 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0ec2c917-89db-43fe-b9aa-cd57615d28d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:18.795496 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0ec2c917-89db-43fe-b9aa-cd57615d28d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1739 microversion: 2.20 time: 0.208631 Jul 27 04:25:18.810003 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 195/379] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:18 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:19.822488 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-924e1410-eecc-4466-a65c-f01723407c90 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:19.823105 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-924e1410-eecc-4466-a65c-f01723407c90 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:19.829497 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-924e1410-eecc-4466-a65c-f01723407c90 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:19.829947 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-924e1410-eecc-4466-a65c-f01723407c90 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:19.830756 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-924e1410-eecc-4466-a65c-f01723407c90 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:19.831401 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-924e1410-eecc-4466-a65c-f01723407c90 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:20.076061 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-924e1410-eecc-4466-a65c-f01723407c90 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:20.084976 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-924e1410-eecc-4466-a65c-f01723407c90 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:20.086708 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-924e1410-eecc-4466-a65c-f01723407c90 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:20.088629 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-924e1410-eecc-4466-a65c-f01723407c90 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1739 microversion: 2.20 time: 0.271292 Jul 27 04:25:20.102169 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 185/380] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:19 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:21.113168 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0dcd1e32-33b6-450a-bf60-51bfb9537c24 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:21.113896 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0dcd1e32-33b6-450a-bf60-51bfb9537c24 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:21.116492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=60 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:21.125791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0dcd1e32-33b6-450a-bf60-51bfb9537c24 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:21.126550 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0dcd1e32-33b6-450a-bf60-51bfb9537c24 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:21.127503 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0dcd1e32-33b6-450a-bf60-51bfb9537c24 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:21.128124 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0dcd1e32-33b6-450a-bf60-51bfb9537c24 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:21.312751 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0dcd1e32-33b6-450a-bf60-51bfb9537c24 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:21.323442 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0dcd1e32-33b6-450a-bf60-51bfb9537c24 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:21.325163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0dcd1e32-33b6-450a-bf60-51bfb9537c24 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:21.326743 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0dcd1e32-33b6-450a-bf60-51bfb9537c24 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1739 microversion: 2.20 time: 0.217776 Jul 27 04:25:21.327323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 196/381] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:21 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:21.637019 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6a8df426-21da-4aec-b583-e859128cc922 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:21.638231 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6a8df426-21da-4aec-b583-e859128cc922 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:21.644805 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=60 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:21.646368 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6a8df426-21da-4aec-b583-e859128cc922 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:21.647318 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6a8df426-21da-4aec-b583-e859128cc922 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:21.648241 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6a8df426-21da-4aec-b583-e859128cc922 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:21.648803 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6a8df426-21da-4aec-b583-e859128cc922 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:21.784767 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.objects.instance [None req-6a8df426-21da-4aec-b583-e859128cc922 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lazy-loading 'services' on Instance uuid d34ccad8-647b-4f91-8817-afd14795fc48 {{(pid=117739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:25:21.921080 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6a8df426-21da-4aec-b583-e859128cc922 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48/os-volume_attachments/cc4ff93d-3825-43e3-9795-7a7bc94d3a66" status: 202 len: 0 microversion: 2.1 time: 0.288004 Jul 27 04:25:21.924986 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 186/382] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Jul 27 04:25:21 2022] DELETE /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48/os-volume_attachments/cc4ff93d-3825-43e3-9795-7a7bc94d3a66 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:25:22.352443 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f3b1ad6d-0645-484c-88f5-28cce6f3ac5f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:22.355180 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f3b1ad6d-0645-484c-88f5-28cce6f3ac5f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:22.362269 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f3b1ad6d-0645-484c-88f5-28cce6f3ac5f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:22.363030 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f3b1ad6d-0645-484c-88f5-28cce6f3ac5f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:22.363899 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f3b1ad6d-0645-484c-88f5-28cce6f3ac5f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:22.364400 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f3b1ad6d-0645-484c-88f5-28cce6f3ac5f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:22.520098 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f3b1ad6d-0645-484c-88f5-28cce6f3ac5f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:22.530119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f3b1ad6d-0645-484c-88f5-28cce6f3ac5f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:22.531638 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f3b1ad6d-0645-484c-88f5-28cce6f3ac5f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:22.533032 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f3b1ad6d-0645-484c-88f5-28cce6f3ac5f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1739 microversion: 2.20 time: 0.184713 Jul 27 04:25:22.534097 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 197/383] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:22 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:23.053363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5d1f02ee-1279-4c3f-9756-0011857c7b10 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:23.054051 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-5d1f02ee-1279-4c3f-9756-0011857c7b10 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:23.062333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5d1f02ee-1279-4c3f-9756-0011857c7b10 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:23.062774 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5d1f02ee-1279-4c3f-9756-0011857c7b10 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:23.063539 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5d1f02ee-1279-4c3f-9756-0011857c7b10 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:23.063965 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5d1f02ee-1279-4c3f-9756-0011857c7b10 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:23.091573 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-5d1f02ee-1279-4c3f-9756-0011857c7b10 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Going to try to terminate instance {{(pid=117739) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:25:23.201723 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-5d1f02ee-1279-4c3f-9756-0011857c7b10 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 204 len: 0 microversion: 2.1 time: 0.153972 Jul 27 04:25:23.202599 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 187/384] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:25:23 2022] DELETE /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:25:23.211340 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b9601ddc-abee-458c-ae12-daaddd5569fd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:23.212140 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b9601ddc-abee-458c-ae12-daaddd5569fd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:23.218991 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b9601ddc-abee-458c-ae12-daaddd5569fd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:23.219447 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b9601ddc-abee-458c-ae12-daaddd5569fd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:23.220365 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b9601ddc-abee-458c-ae12-daaddd5569fd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:23.220836 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b9601ddc-abee-458c-ae12-daaddd5569fd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:23.369930 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b9601ddc-abee-458c-ae12-daaddd5569fd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:23.379032 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b9601ddc-abee-458c-ae12-daaddd5569fd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1511 microversion: 2.1 time: 0.172081 Jul 27 04:25:23.379690 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 198/385] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:23 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:25:23.559046 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ffd02fab-970e-4297-b182-f6b73b2026fe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:23.559662 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ffd02fab-970e-4297-b182-f6b73b2026fe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:23.566087 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ffd02fab-970e-4297-b182-f6b73b2026fe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:23.566724 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ffd02fab-970e-4297-b182-f6b73b2026fe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:23.567612 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ffd02fab-970e-4297-b182-f6b73b2026fe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:23.568118 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ffd02fab-970e-4297-b182-f6b73b2026fe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:23.721717 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ffd02fab-970e-4297-b182-f6b73b2026fe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:23.730809 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ffd02fab-970e-4297-b182-f6b73b2026fe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:23.732301 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ffd02fab-970e-4297-b182-f6b73b2026fe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:23.733607 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ffd02fab-970e-4297-b182-f6b73b2026fe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1739 microversion: 2.20 time: 0.180004 Jul 27 04:25:23.739637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 188/386] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:23 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:24.401442 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-59ba002c-ca0a-4a22-af3e-8870928496a6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:24.402451 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-59ba002c-ca0a-4a22-af3e-8870928496a6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:24.410875 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-59ba002c-ca0a-4a22-af3e-8870928496a6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:24.411316 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-59ba002c-ca0a-4a22-af3e-8870928496a6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:24.412080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-59ba002c-ca0a-4a22-af3e-8870928496a6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:24.412679 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-59ba002c-ca0a-4a22-af3e-8870928496a6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:24.565589 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-59ba002c-ca0a-4a22-af3e-8870928496a6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:24.575928 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-59ba002c-ca0a-4a22-af3e-8870928496a6 tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1511 microversion: 2.1 time: 0.178467 Jul 27 04:25:24.576826 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 199/387] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:24 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:24.757843 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-1720ee3b-fb82-467c-b83c-fbd2bd23bc7b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:24.758421 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-1720ee3b-fb82-467c-b83c-fbd2bd23bc7b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:24.772412 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1720ee3b-fb82-467c-b83c-fbd2bd23bc7b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:24.772412 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1720ee3b-fb82-467c-b83c-fbd2bd23bc7b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:24.772412 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1720ee3b-fb82-467c-b83c-fbd2bd23bc7b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:24.772412 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1720ee3b-fb82-467c-b83c-fbd2bd23bc7b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:24.924598 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-1720ee3b-fb82-467c-b83c-fbd2bd23bc7b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:24.934335 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-1720ee3b-fb82-467c-b83c-fbd2bd23bc7b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:24.935836 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-1720ee3b-fb82-467c-b83c-fbd2bd23bc7b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:24.937384 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-1720ee3b-fb82-467c-b83c-fbd2bd23bc7b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1739 microversion: 2.20 time: 0.183607 Jul 27 04:25:24.937942 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 189/388] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:24 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:25.567461 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-9bd8bc27-6a91-4bc3-bfdf-1cf98fc55817 req-3488154f-ac13-442b-9964-900257590f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34ccad8-647b-4f91-8817-afd14795fc48", "name": "network-vif-deleted", "tag": "e26e4869-2678-4ad7-9013-275bf65dd342"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:25:25.583679 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-9bd8bc27-6a91-4bc3-bfdf-1cf98fc55817 req-3488154f-ac13-442b-9964-900257590f11 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:25.584518 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-9bd8bc27-6a91-4bc3-bfdf-1cf98fc55817 req-3488154f-ac13-442b-9964-900257590f11 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:25.598901 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c05569e3-c185-4307-b310-98d2be407b2e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:25.599848 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c05569e3-c185-4307-b310-98d2be407b2e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:25.600463 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-9bd8bc27-6a91-4bc3-bfdf-1cf98fc55817 req-3488154f-ac13-442b-9964-900257590f11 service nova] Creating event network-vif-deleted:e26e4869-2678-4ad7-9013-275bf65dd342 for instance d34ccad8-647b-4f91-8817-afd14795fc48 on hv-cinder-85098 Jul 27 04:25:25.608424 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-9bd8bc27-6a91-4bc3-bfdf-1cf98fc55817 req-3488154f-ac13-442b-9964-900257590f11 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045732 Jul 27 04:25:25.609343 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 200/389] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:25:25.623858 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c05569e3-c185-4307-b310-98d2be407b2e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:25.624660 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c05569e3-c185-4307-b310-98d2be407b2e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:25.625116 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c05569e3-c185-4307-b310-98d2be407b2e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:25.625554 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c05569e3-c185-4307-b310-98d2be407b2e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:25.710112 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c05569e3-c185-4307-b310-98d2be407b2e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937a7097c9d84402882f73082cfa408f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c6bc5f81ac457dbb91c5bc1a8f0d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:25.719912 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c05569e3-c185-4307-b310-98d2be407b2e tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 200 len: 1303 microversion: 2.1 time: 0.126190 Jul 27 04:25:25.722401 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 190/390] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:25 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:25.964804 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-cae8ac69-5a61-4309-81e7-2d80e0f7435e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:25.965429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-cae8ac69-5a61-4309-81e7-2d80e0f7435e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:25.972170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cae8ac69-5a61-4309-81e7-2d80e0f7435e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:25.975902 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cae8ac69-5a61-4309-81e7-2d80e0f7435e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:25.975902 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cae8ac69-5a61-4309-81e7-2d80e0f7435e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:25.975902 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cae8ac69-5a61-4309-81e7-2d80e0f7435e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:26.148237 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-cae8ac69-5a61-4309-81e7-2d80e0f7435e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:26.157642 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-cae8ac69-5a61-4309-81e7-2d80e0f7435e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:26.159180 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-cae8ac69-5a61-4309-81e7-2d80e0f7435e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:26.160337 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-cae8ac69-5a61-4309-81e7-2d80e0f7435e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1739 microversion: 2.20 time: 0.201379 Jul 27 04:25:26.161100 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 201/391] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:25 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:26.741143 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-856b2d59-2d9c-4690-bd6a-8b671aa1ccdd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:26.741722 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-856b2d59-2d9c-4690-bd6a-8b671aa1ccdd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] [instance: d34ccad8-647b-4f91-8817-afd14795fc48] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:26.748640 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-856b2d59-2d9c-4690-bd6a-8b671aa1ccdd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:26.749094 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-856b2d59-2d9c-4690-bd6a-8b671aa1ccdd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:26.749883 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-856b2d59-2d9c-4690-bd6a-8b671aa1ccdd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:26.750436 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-856b2d59-2d9c-4690-bd6a-8b671aa1ccdd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:26.764956 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-856b2d59-2d9c-4690-bd6a-8b671aa1ccdd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] HTTP exception thrown: Instance d34ccad8-647b-4f91-8817-afd14795fc48 could not be found. Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-856b2d59-2d9c-4690-bd6a-8b671aa1ccdd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Request method failure captured: Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 HTTP/1.1 Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L2tzZvgQnplZ2sLCrInmw0QEPRP_r9vCSlLlcnvsShWijvZH4aDxI5rK7sKkcZbc3Sdk5bmxHkNW617KDm15n3ECHSQFIjGQeLgf3vc862dRDXdRNSg4UnqVB03vVLX8R1Namy2RmMnpB2JWBK1fkYd54v62Ptm-tMFsAxgMxZESwM Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: a4c6bc5f81ac457dbb91c5bc1a8f0d61 Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-VolumesSnapshotTestJSON-341356136 Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:25:26.766777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:25:26.768355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a4c6bc5f81ac457dbb91c5bc1a8f0d61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a4c6bc5f81ac457dbb91c5bc1a8f0d61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a4c6bc5f81ac457dbb91c5bc1a8f0d61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a4c6bc5f81ac457dbb91c5bc1a8f0d61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:25:26.768355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-VolumesSnapshotTestJSON-341356136 Jul 27 04:25:26.768355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: a4c6bc5f81ac457dbb91c5bc1a8f0d61 Jul 27 04:25:26.768355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-341356136 Jul 27 04:25:26.768355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-VolumesSnapshotTestJSON-341356136-project Jul 27 04:25:26.768355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:25:26.768355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:25:26.768355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 937a7097c9d84402882f73082cfa408f Jul 27 04:25:26.768355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-VolumesSnapshotTestJSON-341356136-project Jul 27 04:25:26.768355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:25:26.768355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance d34ccad8-647b-4f91-8817-afd14795fc48 could not be found. Jul 27 04:25:26.768355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': 'd34ccad8-647b-4f91-8817-afd14795fc48'} Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34ccad8-647b-4f91-8817-afd14795fc48 could not be found. Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:25:26.769170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34ccad8-647b-4f91-8817-afd14795fc48 could not be found. Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34ccad8-647b-4f91-8817-afd14795fc48 could not be found. Jul 27 04:25:26.770446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:25:26.771532 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-856b2d59-2d9c-4690-bd6a-8b671aa1ccdd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] Returning 404 to user: Instance d34ccad8-647b-4f91-8817-afd14795fc48 could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:25:26.771532 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-856b2d59-2d9c-4690-bd6a-8b671aa1ccdd tempest-VolumesSnapshotTestJSON-341356136 tempest-VolumesSnapshotTestJSON-341356136-project] 10.222.0.46 "GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48" status: 404 len: 111 microversion: 2.1 time: 0.031029 Jul 27 04:25:26.771532 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 191/392] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:26 2022] GET /compute/v2.1/servers/d34ccad8-647b-4f91-8817-afd14795fc48 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:25:27.186968 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-6aaaede6-335b-439e-b1eb-586bbb8020de tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:27.187845 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-6aaaede6-335b-439e-b1eb-586bbb8020de tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:27.195047 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6aaaede6-335b-439e-b1eb-586bbb8020de tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:27.196025 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6aaaede6-335b-439e-b1eb-586bbb8020de tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:27.197063 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6aaaede6-335b-439e-b1eb-586bbb8020de tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:27.197719 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6aaaede6-335b-439e-b1eb-586bbb8020de tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:27.349133 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-6aaaede6-335b-439e-b1eb-586bbb8020de tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:27.357893 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-6aaaede6-335b-439e-b1eb-586bbb8020de tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:27.359464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-6aaaede6-335b-439e-b1eb-586bbb8020de tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:27.360610 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-6aaaede6-335b-439e-b1eb-586bbb8020de tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1739 microversion: 2.20 time: 0.180980 Jul 27 04:25:27.361167 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 202/393] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:27 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:25:28.385308 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4e3a27ab-50aa-4983-bdba-72b5ff65e0a0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:28.385876 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4e3a27ab-50aa-4983-bdba-72b5ff65e0a0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:28.392487 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e3a27ab-50aa-4983-bdba-72b5ff65e0a0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:28.392968 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e3a27ab-50aa-4983-bdba-72b5ff65e0a0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:28.393735 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e3a27ab-50aa-4983-bdba-72b5ff65e0a0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:28.394199 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e3a27ab-50aa-4983-bdba-72b5ff65e0a0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:28.549582 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4e3a27ab-50aa-4983-bdba-72b5ff65e0a0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:28.560546 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4e3a27ab-50aa-4983-bdba-72b5ff65e0a0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:28.562103 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4e3a27ab-50aa-4983-bdba-72b5ff65e0a0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:28.563267 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4e3a27ab-50aa-4983-bdba-72b5ff65e0a0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1721 microversion: 2.20 time: 0.182763 Jul 27 04:25:28.563906 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 192/394] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:28 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:29.586955 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-91f1526e-ad25-462d-a69f-29c21b0d2a58 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:29.588237 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-91f1526e-ad25-462d-a69f-29c21b0d2a58 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:29.594699 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-91f1526e-ad25-462d-a69f-29c21b0d2a58 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:29.595146 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-91f1526e-ad25-462d-a69f-29c21b0d2a58 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:29.595902 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-91f1526e-ad25-462d-a69f-29c21b0d2a58 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:29.596330 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-91f1526e-ad25-462d-a69f-29c21b0d2a58 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:29.722657 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-91f1526e-ad25-462d-a69f-29c21b0d2a58 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:29.730462 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-91f1526e-ad25-462d-a69f-29c21b0d2a58 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:29.731983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-91f1526e-ad25-462d-a69f-29c21b0d2a58 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:29.733109 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-91f1526e-ad25-462d-a69f-29c21b0d2a58 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1721 microversion: 2.20 time: 0.150073 Jul 27 04:25:29.733666 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 203/395] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:29 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:30.758239 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5ac469b3-8827-40a7-bccb-44e91cd93198 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:30.758851 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-5ac469b3-8827-40a7-bccb-44e91cd93198 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:30.765991 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5ac469b3-8827-40a7-bccb-44e91cd93198 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:30.766441 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5ac469b3-8827-40a7-bccb-44e91cd93198 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:30.767207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5ac469b3-8827-40a7-bccb-44e91cd93198 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:30.767636 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5ac469b3-8827-40a7-bccb-44e91cd93198 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:30.894257 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-5ac469b3-8827-40a7-bccb-44e91cd93198 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:30.902719 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-5ac469b3-8827-40a7-bccb-44e91cd93198 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:30.904286 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-5ac469b3-8827-40a7-bccb-44e91cd93198 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:30.905377 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-5ac469b3-8827-40a7-bccb-44e91cd93198 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1721 microversion: 2.20 time: 0.151083 Jul 27 04:25:30.905933 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 193/396] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:30 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:31.928556 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c9e327db-5826-42d7-99ed-1e09ab250c3f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:31.929198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c9e327db-5826-42d7-99ed-1e09ab250c3f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:31.935690 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c9e327db-5826-42d7-99ed-1e09ab250c3f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:31.936070 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c9e327db-5826-42d7-99ed-1e09ab250c3f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:31.936818 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c9e327db-5826-42d7-99ed-1e09ab250c3f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:31.937242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c9e327db-5826-42d7-99ed-1e09ab250c3f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:32.283729 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-c9e327db-5826-42d7-99ed-1e09ab250c3f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:32.291836 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-c9e327db-5826-42d7-99ed-1e09ab250c3f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:32.293330 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-c9e327db-5826-42d7-99ed-1e09ab250c3f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:32.294511 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c9e327db-5826-42d7-99ed-1e09ab250c3f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1721 microversion: 2.20 time: 0.369839 Jul 27 04:25:32.295072 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 204/397] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:31 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1721 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:32.637068 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-5ff8c84c-f7ab-44cc-9f39-676fe960482e req-3b96f3ae-56fc-49cf-a8fa-731f938ba63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9478c2cb-a66c-4485-91bf-fe8486025afe", "name": "network-vif-unplugged", "status": "completed", "tag": "d905ab8e-bb09-45aa-9436-9f67042c2d1a"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:25:32.647729 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-5ff8c84c-f7ab-44cc-9f39-676fe960482e req-3b96f3ae-56fc-49cf-a8fa-731f938ba63f service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:32.648023 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-5ff8c84c-f7ab-44cc-9f39-676fe960482e req-3b96f3ae-56fc-49cf-a8fa-731f938ba63f service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:32.661500 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-5ff8c84c-f7ab-44cc-9f39-676fe960482e req-3b96f3ae-56fc-49cf-a8fa-731f938ba63f service nova] Creating event network-vif-unplugged:d905ab8e-bb09-45aa-9436-9f67042c2d1a for instance 9478c2cb-a66c-4485-91bf-fe8486025afe on hv-cinder-85098 Jul 27 04:25:32.667179 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-5ff8c84c-f7ab-44cc-9f39-676fe960482e req-3b96f3ae-56fc-49cf-a8fa-731f938ba63f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034089 Jul 27 04:25:32.669229 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 194/398] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:25:33.317626 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-51a43327-a9cf-4467-86a6-8fe94ccef692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:33.318162 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-51a43327-a9cf-4467-86a6-8fe94ccef692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:33.325654 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-51a43327-a9cf-4467-86a6-8fe94ccef692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:33.326161 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-51a43327-a9cf-4467-86a6-8fe94ccef692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:33.326922 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-51a43327-a9cf-4467-86a6-8fe94ccef692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:33.327356 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-51a43327-a9cf-4467-86a6-8fe94ccef692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:33.377017 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5073b5ca-55e7-437f-b1f0-cb42400ef1f2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f4a7c98-5169-43d5-a87c-a1fdac6de475"}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:25:33.379577 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-5073b5ca-55e7-437f-b1f0-cb42400ef1f2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:33.386443 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5073b5ca-55e7-437f-b1f0-cb42400ef1f2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:33.386901 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5073b5ca-55e7-437f-b1f0-cb42400ef1f2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:33.387676 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5073b5ca-55e7-437f-b1f0-cb42400ef1f2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:33.388110 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5073b5ca-55e7-437f-b1f0-cb42400ef1f2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:33.465167 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-51a43327-a9cf-4467-86a6-8fe94ccef692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:33.474119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-51a43327-a9cf-4467-86a6-8fe94ccef692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:33.475619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-51a43327-a9cf-4467-86a6-8fe94ccef692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:33.476764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-51a43327-a9cf-4467-86a6-8fe94ccef692 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1724 microversion: 2.20 time: 0.163173 Jul 27 04:25:33.477329 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 205/399] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:33 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:33.500442 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-72ea70bd-fa08-4263-956b-f500074db6aa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d677366-6d4f-4e3c-a8f2-64da03c246cc"}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:25:33.502941 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-72ea70bd-fa08-4263-956b-f500074db6aa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:33.509097 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-72ea70bd-fa08-4263-956b-f500074db6aa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:33.510202 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-72ea70bd-fa08-4263-956b-f500074db6aa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:33.510982 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-72ea70bd-fa08-4263-956b-f500074db6aa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:33.511603 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-72ea70bd-fa08-4263-956b-f500074db6aa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:33.655356 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-5073b5ca-55e7-437f-b1f0-cb42400ef1f2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "POST /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282807 Jul 27 04:25:33.656067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 195/400] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:25:33 2022] POST /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:25:33.820223 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-72ea70bd-fa08-4263-956b-f500074db6aa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "POST /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323801 Jul 27 04:25:33.826909 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 206/401] 10.222.0.46 () {62 vars in 1364 bytes} [Wed Jul 27 04:25:33 2022] POST /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 04:25:33.944870 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f4cc4edd-88f1-4c13-8f29-c1c86f33d223 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:25:33.945543 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f4cc4edd-88f1-4c13-8f29-c1c86f33d223 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:33.951901 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f4cc4edd-88f1-4c13-8f29-c1c86f33d223 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:33.952370 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f4cc4edd-88f1-4c13-8f29-c1c86f33d223 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:33.953126 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f4cc4edd-88f1-4c13-8f29-c1c86f33d223 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:33.953552 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f4cc4edd-88f1-4c13-8f29-c1c86f33d223 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:34.051372 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f4cc4edd-88f1-4c13-8f29-c1c86f33d223 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "POST /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/action" status: 202 len: 0 microversion: 2.20 time: 0.111012 Jul 27 04:25:34.055103 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 196/402] 10.222.0.46 () {62 vars in 1319 bytes} [Wed Jul 27 04:25:33 2022] POST /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:25:34.062004 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d5e3f476-3193-4a9f-bcb3-0618d2ddeffe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:34.062815 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d5e3f476-3193-4a9f-bcb3-0618d2ddeffe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:34.069358 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d5e3f476-3193-4a9f-bcb3-0618d2ddeffe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:34.069809 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d5e3f476-3193-4a9f-bcb3-0618d2ddeffe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:34.070936 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d5e3f476-3193-4a9f-bcb3-0618d2ddeffe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:34.071388 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d5e3f476-3193-4a9f-bcb3-0618d2ddeffe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:34.238877 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d5e3f476-3193-4a9f-bcb3-0618d2ddeffe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:34.248668 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d5e3f476-3193-4a9f-bcb3-0618d2ddeffe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:34.250559 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d5e3f476-3193-4a9f-bcb3-0618d2ddeffe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:34.251882 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d5e3f476-3193-4a9f-bcb3-0618d2ddeffe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1750 microversion: 2.20 time: 0.195524 Jul 27 04:25:34.252947 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 207/403] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:34 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1750 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:25:35.277418 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-713d0df0-56e2-4391-8e45-73b60e277037 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:35.278049 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-713d0df0-56e2-4391-8e45-73b60e277037 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:35.283959 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-713d0df0-56e2-4391-8e45-73b60e277037 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:35.284404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-713d0df0-56e2-4391-8e45-73b60e277037 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:35.285161 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-713d0df0-56e2-4391-8e45-73b60e277037 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:35.285595 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-713d0df0-56e2-4391-8e45-73b60e277037 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:35.288224 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:35.425399 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-713d0df0-56e2-4391-8e45-73b60e277037 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:35.435329 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-713d0df0-56e2-4391-8e45-73b60e277037 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:35.436842 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-713d0df0-56e2-4391-8e45-73b60e277037 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:35.438290 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-713d0df0-56e2-4391-8e45-73b60e277037 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1752 microversion: 2.20 time: 0.165097 Jul 27 04:25:35.439064 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 197/404] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:35 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:36.462072 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-6e6999f4-658f-45a1-a92c-6999b1152d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:36.462694 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-6e6999f4-658f-45a1-a92c-6999b1152d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:36.469298 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6e6999f4-658f-45a1-a92c-6999b1152d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:36.469743 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6e6999f4-658f-45a1-a92c-6999b1152d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:36.470545 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6e6999f4-658f-45a1-a92c-6999b1152d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:36.470983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6e6999f4-658f-45a1-a92c-6999b1152d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:36.602021 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-6e6999f4-658f-45a1-a92c-6999b1152d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:36.610304 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-6e6999f4-658f-45a1-a92c-6999b1152d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:36.611788 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-6e6999f4-658f-45a1-a92c-6999b1152d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:36.612925 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-6e6999f4-658f-45a1-a92c-6999b1152d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1752 microversion: 2.20 time: 0.154813 Jul 27 04:25:36.613483 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 208/405] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:36 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:37.637422 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c570b06c-d18f-42a8-9ea7-23e645fcf06c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:37.638060 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c570b06c-d18f-42a8-9ea7-23e645fcf06c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:37.644757 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c570b06c-d18f-42a8-9ea7-23e645fcf06c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:37.645102 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c570b06c-d18f-42a8-9ea7-23e645fcf06c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:37.645874 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c570b06c-d18f-42a8-9ea7-23e645fcf06c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:37.646338 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c570b06c-d18f-42a8-9ea7-23e645fcf06c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:37.777799 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c570b06c-d18f-42a8-9ea7-23e645fcf06c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:37.786153 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c570b06c-d18f-42a8-9ea7-23e645fcf06c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:37.787652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c570b06c-d18f-42a8-9ea7-23e645fcf06c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:37.788793 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c570b06c-d18f-42a8-9ea7-23e645fcf06c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1752 microversion: 2.20 time: 0.156321 Jul 27 04:25:37.789350 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 198/406] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:37 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:38.812228 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b2c2ce15-6ec7-4325-a53f-2dfbe5d4fd2a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:38.812790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b2c2ce15-6ec7-4325-a53f-2dfbe5d4fd2a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:38.819096 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b2c2ce15-6ec7-4325-a53f-2dfbe5d4fd2a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:38.819538 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b2c2ce15-6ec7-4325-a53f-2dfbe5d4fd2a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:38.820312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b2c2ce15-6ec7-4325-a53f-2dfbe5d4fd2a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:38.821006 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b2c2ce15-6ec7-4325-a53f-2dfbe5d4fd2a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:38.949262 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b2c2ce15-6ec7-4325-a53f-2dfbe5d4fd2a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:38.958372 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b2c2ce15-6ec7-4325-a53f-2dfbe5d4fd2a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:38.959868 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b2c2ce15-6ec7-4325-a53f-2dfbe5d4fd2a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:38.961014 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b2c2ce15-6ec7-4325-a53f-2dfbe5d4fd2a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1752 microversion: 2.20 time: 0.152789 Jul 27 04:25:38.961561 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 209/407] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:38 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:39.985524 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-160d6146-b543-483d-bf34-f13544ba0cf1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:39.986253 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-160d6146-b543-483d-bf34-f13544ba0cf1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:39.993646 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-160d6146-b543-483d-bf34-f13544ba0cf1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:39.994114 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-160d6146-b543-483d-bf34-f13544ba0cf1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:39.995418 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-160d6146-b543-483d-bf34-f13544ba0cf1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:39.995856 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-160d6146-b543-483d-bf34-f13544ba0cf1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:40.137304 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-160d6146-b543-483d-bf34-f13544ba0cf1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:40.146500 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-160d6146-b543-483d-bf34-f13544ba0cf1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:40.148271 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-160d6146-b543-483d-bf34-f13544ba0cf1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:40.149523 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-160d6146-b543-483d-bf34-f13544ba0cf1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1752 microversion: 2.20 time: 0.168215 Jul 27 04:25:40.150183 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 199/408] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:39 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:41.176035 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3971d8d8-48c1-43f1-9778-d2ebc8221ea1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:41.176688 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3971d8d8-48c1-43f1-9778-d2ebc8221ea1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:41.197655 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3971d8d8-48c1-43f1-9778-d2ebc8221ea1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:41.198143 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3971d8d8-48c1-43f1-9778-d2ebc8221ea1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:41.199159 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3971d8d8-48c1-43f1-9778-d2ebc8221ea1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:41.199418 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3971d8d8-48c1-43f1-9778-d2ebc8221ea1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:41.209693 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6abb0ef3-dfe5-4bfd-974c-07e819ff961d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:25:41.212028 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6abb0ef3-dfe5-4bfd-974c-07e819ff961d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:41.215958 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:41.219344 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6abb0ef3-dfe5-4bfd-974c-07e819ff961d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:41.219787 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6abb0ef3-dfe5-4bfd-974c-07e819ff961d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:41.220827 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6abb0ef3-dfe5-4bfd-974c-07e819ff961d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:41.221189 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6abb0ef3-dfe5-4bfd-974c-07e819ff961d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:41.247518 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.objects.instance [None req-6abb0ef3-dfe5-4bfd-974c-07e819ff961d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lazy-loading 'flavor' on Instance uuid 1b1166f3-79b8-48f8-87a6-3c6da0593d1d {{(pid=117739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:25:41.378308 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6abb0ef3-dfe5-4bfd-974c-07e819ff961d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "POST /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/action" status: 200 len: 32 microversion: 2.1 time: 0.172850 Jul 27 04:25:41.379284 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 200/409] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:25:41 2022] POST /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 04:25:41.389713 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-1240af63-0780-4b8c-b915-5d4ffccd3e3d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:41.390449 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-1240af63-0780-4b8c-b915-5d4ffccd3e3d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:41.397057 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1240af63-0780-4b8c-b915-5d4ffccd3e3d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:41.398473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1240af63-0780-4b8c-b915-5d4ffccd3e3d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:41.402685 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1240af63-0780-4b8c-b915-5d4ffccd3e3d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:41.403246 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1240af63-0780-4b8c-b915-5d4ffccd3e3d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:41.432204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3971d8d8-48c1-43f1-9778-d2ebc8221ea1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:41.448824 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3971d8d8-48c1-43f1-9778-d2ebc8221ea1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:41.452448 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3971d8d8-48c1-43f1-9778-d2ebc8221ea1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:41.454220 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3971d8d8-48c1-43f1-9778-d2ebc8221ea1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.282622 Jul 27 04:25:41.454934 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 210/410] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:41 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:41.656639 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-1240af63-0780-4b8c-b915-5d4ffccd3e3d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:41.665042 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-1240af63-0780-4b8c-b915-5d4ffccd3e3d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.280167 Jul 27 04:25:41.665810 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 201/411] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:41 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:25:42.479173 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b494e768-87f4-41b3-a397-0b4e26bb4208 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:42.479789 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b494e768-87f4-41b3-a397-0b4e26bb4208 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:42.487361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b494e768-87f4-41b3-a397-0b4e26bb4208 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:42.487900 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b494e768-87f4-41b3-a397-0b4e26bb4208 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:42.488684 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b494e768-87f4-41b3-a397-0b4e26bb4208 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:42.489123 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b494e768-87f4-41b3-a397-0b4e26bb4208 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:42.639742 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b494e768-87f4-41b3-a397-0b4e26bb4208 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:42.648483 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b494e768-87f4-41b3-a397-0b4e26bb4208 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:42.650007 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b494e768-87f4-41b3-a397-0b4e26bb4208 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:42.652150 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b494e768-87f4-41b3-a397-0b4e26bb4208 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.177009 Jul 27 04:25:42.652757 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 211/412] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:42 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:25:42.686457 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-bbb2762d-f6d7-4725-9a59-cf77c2b90209 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:42.687065 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-bbb2762d-f6d7-4725-9a59-cf77c2b90209 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:42.693628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bbb2762d-f6d7-4725-9a59-cf77c2b90209 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:42.694103 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bbb2762d-f6d7-4725-9a59-cf77c2b90209 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:42.694868 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bbb2762d-f6d7-4725-9a59-cf77c2b90209 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:42.695296 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bbb2762d-f6d7-4725-9a59-cf77c2b90209 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:42.837518 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-bbb2762d-f6d7-4725-9a59-cf77c2b90209 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:42.846835 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-bbb2762d-f6d7-4725-9a59-cf77c2b90209 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.164121 Jul 27 04:25:42.847418 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 202/413] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:42 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:25:43.676153 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-823f05ce-495d-4c40-885c-01ea7d9cbabd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:43.677061 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-823f05ce-495d-4c40-885c-01ea7d9cbabd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:43.684482 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-823f05ce-495d-4c40-885c-01ea7d9cbabd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:43.684928 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-823f05ce-495d-4c40-885c-01ea7d9cbabd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:43.685697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-823f05ce-495d-4c40-885c-01ea7d9cbabd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:43.686777 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-823f05ce-495d-4c40-885c-01ea7d9cbabd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:43.853716 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-823f05ce-495d-4c40-885c-01ea7d9cbabd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:43.864922 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-823f05ce-495d-4c40-885c-01ea7d9cbabd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:43.866827 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-823f05ce-495d-4c40-885c-01ea7d9cbabd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:43.868521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-823f05ce-495d-4c40-885c-01ea7d9cbabd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.196768 Jul 27 04:25:43.870209 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 212/414] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:43 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:43.875634 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-80886e53-1463-4663-925d-b0416eb80f85 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:43.876951 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-80886e53-1463-4663-925d-b0416eb80f85 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:43.883759 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-80886e53-1463-4663-925d-b0416eb80f85 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:43.885372 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-80886e53-1463-4663-925d-b0416eb80f85 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:43.885846 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-80886e53-1463-4663-925d-b0416eb80f85 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:43.886510 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-80886e53-1463-4663-925d-b0416eb80f85 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:44.032630 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-80886e53-1463-4663-925d-b0416eb80f85 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:44.040890 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-80886e53-1463-4663-925d-b0416eb80f85 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.175542 Jul 27 04:25:44.042029 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 203/415] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:43 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:25:44.893761 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e5e7f4d8-99e6-4766-a73b-ec50204eb465 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:44.894652 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e5e7f4d8-99e6-4766-a73b-ec50204eb465 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:44.902524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e5e7f4d8-99e6-4766-a73b-ec50204eb465 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:44.903120 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e5e7f4d8-99e6-4766-a73b-ec50204eb465 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:44.903967 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e5e7f4d8-99e6-4766-a73b-ec50204eb465 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:44.904471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e5e7f4d8-99e6-4766-a73b-ec50204eb465 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:45.061033 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e5e7f4d8-99e6-4766-a73b-ec50204eb465 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:45.067920 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-661a9c37-947c-4505-bde0-49c0734d585a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:45.069294 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-661a9c37-947c-4505-bde0-49c0734d585a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:45.070463 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e5e7f4d8-99e6-4766-a73b-ec50204eb465 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:45.072833 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e5e7f4d8-99e6-4766-a73b-ec50204eb465 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:45.074780 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e5e7f4d8-99e6-4766-a73b-ec50204eb465 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.185412 Jul 27 04:25:45.089999 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 213/416] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:44 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:45.090252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-661a9c37-947c-4505-bde0-49c0734d585a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:45.090252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-661a9c37-947c-4505-bde0-49c0734d585a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:45.090252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-661a9c37-947c-4505-bde0-49c0734d585a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:45.090252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-661a9c37-947c-4505-bde0-49c0734d585a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:45.247854 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-661a9c37-947c-4505-bde0-49c0734d585a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:45.259433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-661a9c37-947c-4505-bde0-49c0734d585a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.201146 Jul 27 04:25:45.261135 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 204/417] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:45 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:46.102743 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4c755c41-77d3-4575-a8fb-ebb36087d14f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:46.104238 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4c755c41-77d3-4575-a8fb-ebb36087d14f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:46.112647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4c755c41-77d3-4575-a8fb-ebb36087d14f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:46.113329 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4c755c41-77d3-4575-a8fb-ebb36087d14f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:46.114303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4c755c41-77d3-4575-a8fb-ebb36087d14f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:46.114918 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4c755c41-77d3-4575-a8fb-ebb36087d14f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:46.257246 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4c755c41-77d3-4575-a8fb-ebb36087d14f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:46.266387 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4c755c41-77d3-4575-a8fb-ebb36087d14f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:46.267900 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4c755c41-77d3-4575-a8fb-ebb36087d14f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:46.269064 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4c755c41-77d3-4575-a8fb-ebb36087d14f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.171053 Jul 27 04:25:46.269624 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 214/418] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:46 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:46.282766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2501fa7a-37fe-4616-9cd2-fa12d4468137 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:46.283977 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2501fa7a-37fe-4616-9cd2-fa12d4468137 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:46.292006 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2501fa7a-37fe-4616-9cd2-fa12d4468137 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:46.292796 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2501fa7a-37fe-4616-9cd2-fa12d4468137 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:46.293861 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2501fa7a-37fe-4616-9cd2-fa12d4468137 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:46.294451 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2501fa7a-37fe-4616-9cd2-fa12d4468137 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:46.436759 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2501fa7a-37fe-4616-9cd2-fa12d4468137 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:46.446552 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2501fa7a-37fe-4616-9cd2-fa12d4468137 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.167667 Jul 27 04:25:46.447667 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 205/419] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:46 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:47.293217 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-87e04d48-f966-49a6-bcbf-993716d07368 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:47.294507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-87e04d48-f966-49a6-bcbf-993716d07368 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:47.313579 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-87e04d48-f966-49a6-bcbf-993716d07368 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:47.314037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-87e04d48-f966-49a6-bcbf-993716d07368 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:47.315077 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-87e04d48-f966-49a6-bcbf-993716d07368 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:47.315547 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-87e04d48-f966-49a6-bcbf-993716d07368 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:47.454091 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-87e04d48-f966-49a6-bcbf-993716d07368 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:47.463853 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-87e04d48-f966-49a6-bcbf-993716d07368 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:47.465746 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-87e04d48-f966-49a6-bcbf-993716d07368 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:47.471237 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-24101048-29b0-4961-abd7-e9e7a3001cae tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:47.472554 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-24101048-29b0-4961-abd7-e9e7a3001cae tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:47.477800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-87e04d48-f966-49a6-bcbf-993716d07368 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.188671 Jul 27 04:25:47.481833 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-24101048-29b0-4961-abd7-e9e7a3001cae tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:47.482308 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-24101048-29b0-4961-abd7-e9e7a3001cae tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:47.483089 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-24101048-29b0-4961-abd7-e9e7a3001cae tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:47.483526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-24101048-29b0-4961-abd7-e9e7a3001cae tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:47.486419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 215/420] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:47 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:47.635204 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-24101048-29b0-4961-abd7-e9e7a3001cae tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:47.646990 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-24101048-29b0-4961-abd7-e9e7a3001cae tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.179615 Jul 27 04:25:47.648009 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 206/421] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:47 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:48.509393 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-79be1fb8-6084-406e-93dc-ff9ef00ccdd5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:48.510621 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-79be1fb8-6084-406e-93dc-ff9ef00ccdd5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:48.517344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-79be1fb8-6084-406e-93dc-ff9ef00ccdd5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:48.517792 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-79be1fb8-6084-406e-93dc-ff9ef00ccdd5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:48.518631 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-79be1fb8-6084-406e-93dc-ff9ef00ccdd5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:48.519070 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-79be1fb8-6084-406e-93dc-ff9ef00ccdd5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:48.657821 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-79be1fb8-6084-406e-93dc-ff9ef00ccdd5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:48.671111 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7141bb03-a919-4ae3-9a5a-b2c793d5761f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:48.671717 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-7141bb03-a919-4ae3-9a5a-b2c793d5761f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:48.672558 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-79be1fb8-6084-406e-93dc-ff9ef00ccdd5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:48.674201 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-79be1fb8-6084-406e-93dc-ff9ef00ccdd5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:48.675608 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-79be1fb8-6084-406e-93dc-ff9ef00ccdd5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.170448 Jul 27 04:25:48.676486 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 216/422] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:48 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:48.692709 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7141bb03-a919-4ae3-9a5a-b2c793d5761f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:48.693157 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7141bb03-a919-4ae3-9a5a-b2c793d5761f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:48.695475 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7141bb03-a919-4ae3-9a5a-b2c793d5761f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:48.696190 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7141bb03-a919-4ae3-9a5a-b2c793d5761f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:48.837021 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-7141bb03-a919-4ae3-9a5a-b2c793d5761f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:48.850293 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-7141bb03-a919-4ae3-9a5a-b2c793d5761f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.182794 Jul 27 04:25:48.850884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 207/423] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:48 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:49.704078 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-41ab6e49-4b95-42f8-8dc0-4fe980f6fe13 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:49.704808 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-41ab6e49-4b95-42f8-8dc0-4fe980f6fe13 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:49.719566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-41ab6e49-4b95-42f8-8dc0-4fe980f6fe13 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:49.720119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-41ab6e49-4b95-42f8-8dc0-4fe980f6fe13 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:49.720989 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-41ab6e49-4b95-42f8-8dc0-4fe980f6fe13 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:49.721500 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-41ab6e49-4b95-42f8-8dc0-4fe980f6fe13 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:49.877759 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-69b3b5e7-8e70-40ff-94a1-4412fcbc03e3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:49.878554 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-69b3b5e7-8e70-40ff-94a1-4412fcbc03e3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:49.892520 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-69b3b5e7-8e70-40ff-94a1-4412fcbc03e3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:49.893136 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-69b3b5e7-8e70-40ff-94a1-4412fcbc03e3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:49.894045 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-69b3b5e7-8e70-40ff-94a1-4412fcbc03e3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:49.897320 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-69b3b5e7-8e70-40ff-94a1-4412fcbc03e3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:49.897656 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-41ab6e49-4b95-42f8-8dc0-4fe980f6fe13 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:49.909396 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-41ab6e49-4b95-42f8-8dc0-4fe980f6fe13 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:49.911018 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-41ab6e49-4b95-42f8-8dc0-4fe980f6fe13 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:49.912348 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-41ab6e49-4b95-42f8-8dc0-4fe980f6fe13 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.212329 Jul 27 04:25:49.929284 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 217/424] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:49 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:25:50.074630 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-69b3b5e7-8e70-40ff-94a1-4412fcbc03e3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:50.084290 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-69b3b5e7-8e70-40ff-94a1-4412fcbc03e3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.216104 Jul 27 04:25:50.085152 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 208/425] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:49 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:50.937612 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-88de49e3-29dd-4e7c-a823-7894297e728d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:50.938865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-88de49e3-29dd-4e7c-a823-7894297e728d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:50.950655 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-88de49e3-29dd-4e7c-a823-7894297e728d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:50.951117 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-88de49e3-29dd-4e7c-a823-7894297e728d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:50.951905 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-88de49e3-29dd-4e7c-a823-7894297e728d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:50.952346 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-88de49e3-29dd-4e7c-a823-7894297e728d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:51.096228 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-88de49e3-29dd-4e7c-a823-7894297e728d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:51.106256 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-88de49e3-29dd-4e7c-a823-7894297e728d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:51.107814 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-88de49e3-29dd-4e7c-a823-7894297e728d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:51.108997 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-88de49e3-29dd-4e7c-a823-7894297e728d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.176428 Jul 27 04:25:51.109564 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 218/426] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:50 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:51.110650 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-efb12cb4-0c97-45d7-86c9-357a28a32a48 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:51.111804 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-efb12cb4-0c97-45d7-86c9-357a28a32a48 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:51.119530 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-efb12cb4-0c97-45d7-86c9-357a28a32a48 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:51.119979 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-efb12cb4-0c97-45d7-86c9-357a28a32a48 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:51.120748 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-efb12cb4-0c97-45d7-86c9-357a28a32a48 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:51.121180 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-efb12cb4-0c97-45d7-86c9-357a28a32a48 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:51.259314 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-efb12cb4-0c97-45d7-86c9-357a28a32a48 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:51.267888 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-efb12cb4-0c97-45d7-86c9-357a28a32a48 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.161433 Jul 27 04:25:51.268447 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 209/427] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:51 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:25:52.135382 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7c251c0a-69ee-4e65-99a3-d16a47bc406c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:52.136002 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-7c251c0a-69ee-4e65-99a3-d16a47bc406c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:52.138368 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=46 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:52.144092 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7c251c0a-69ee-4e65-99a3-d16a47bc406c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:52.144687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7c251c0a-69ee-4e65-99a3-d16a47bc406c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:52.145466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7c251c0a-69ee-4e65-99a3-d16a47bc406c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:52.145906 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7c251c0a-69ee-4e65-99a3-d16a47bc406c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:52.277174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-7c251c0a-69ee-4e65-99a3-d16a47bc406c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:52.286683 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-7c251c0a-69ee-4e65-99a3-d16a47bc406c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:52.288229 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-7c251c0a-69ee-4e65-99a3-d16a47bc406c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:52.289575 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-7c251c0a-69ee-4e65-99a3-d16a47bc406c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.158049 Jul 27 04:25:52.290257 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 219/428] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:52 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:52.290396 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6c9aaaf1-1dc2-4781-8178-80add056b4b0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:52.291557 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6c9aaaf1-1dc2-4781-8178-80add056b4b0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:52.295989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:52.300711 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6c9aaaf1-1dc2-4781-8178-80add056b4b0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:52.301192 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6c9aaaf1-1dc2-4781-8178-80add056b4b0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:52.302104 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6c9aaaf1-1dc2-4781-8178-80add056b4b0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:52.302532 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6c9aaaf1-1dc2-4781-8178-80add056b4b0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:52.502334 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6c9aaaf1-1dc2-4781-8178-80add056b4b0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:52.510763 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6c9aaaf1-1dc2-4781-8178-80add056b4b0 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.224435 Jul 27 04:25:52.511518 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 210/429] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:52 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:25:53.313365 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-5a235c35-c7ca-4512-affe-2cd35c52fe69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:53.313913 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-5a235c35-c7ca-4512-affe-2cd35c52fe69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:53.320346 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5a235c35-c7ca-4512-affe-2cd35c52fe69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:53.321057 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5a235c35-c7ca-4512-affe-2cd35c52fe69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:53.321838 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5a235c35-c7ca-4512-affe-2cd35c52fe69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:53.322281 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5a235c35-c7ca-4512-affe-2cd35c52fe69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:53.452535 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-5a235c35-c7ca-4512-affe-2cd35c52fe69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:53.460943 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-5a235c35-c7ca-4512-affe-2cd35c52fe69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:53.462512 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-5a235c35-c7ca-4512-affe-2cd35c52fe69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:53.463686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-5a235c35-c7ca-4512-affe-2cd35c52fe69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.154334 Jul 27 04:25:53.464330 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 220/430] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:53 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:53.532116 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-1b582535-ba9e-444e-b36b-a0b4307b43a2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:53.532716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-1b582535-ba9e-444e-b36b-a0b4307b43a2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:53.539281 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1b582535-ba9e-444e-b36b-a0b4307b43a2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:53.539722 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1b582535-ba9e-444e-b36b-a0b4307b43a2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:53.540479 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1b582535-ba9e-444e-b36b-a0b4307b43a2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:53.541406 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1b582535-ba9e-444e-b36b-a0b4307b43a2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:53.674239 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-1b582535-ba9e-444e-b36b-a0b4307b43a2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:53.676402 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:53.684162 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-1b582535-ba9e-444e-b36b-a0b4307b43a2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.155866 Jul 27 04:25:53.684788 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 211/431] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:53 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:54.487428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0d5fd358-fc21-4459-9355-1b679b12f92b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:54.488033 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0d5fd358-fc21-4459-9355-1b679b12f92b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:54.495293 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0d5fd358-fc21-4459-9355-1b679b12f92b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:54.495743 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0d5fd358-fc21-4459-9355-1b679b12f92b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:54.496495 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0d5fd358-fc21-4459-9355-1b679b12f92b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:54.496927 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0d5fd358-fc21-4459-9355-1b679b12f92b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:54.624069 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0d5fd358-fc21-4459-9355-1b679b12f92b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:54.634041 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0d5fd358-fc21-4459-9355-1b679b12f92b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:54.636183 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0d5fd358-fc21-4459-9355-1b679b12f92b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:54.637344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0d5fd358-fc21-4459-9355-1b679b12f92b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.153790 Jul 27 04:25:54.637937 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 221/432] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:54 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:54.706174 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f087becf-520f-4b63-80c9-a635b381631c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:54.706780 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f087becf-520f-4b63-80c9-a635b381631c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:54.715055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f087becf-520f-4b63-80c9-a635b381631c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:54.715443 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f087becf-520f-4b63-80c9-a635b381631c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:54.716203 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f087becf-520f-4b63-80c9-a635b381631c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:54.716638 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f087becf-520f-4b63-80c9-a635b381631c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:54.842722 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f087becf-520f-4b63-80c9-a635b381631c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:54.850532 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f087becf-520f-4b63-80c9-a635b381631c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.148527 Jul 27 04:25:54.851094 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 212/433] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:54 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:55.660626 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-185e2edd-a576-4a04-acd6-1d6c83a97ee4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:55.661236 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-185e2edd-a576-4a04-acd6-1d6c83a97ee4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:55.667841 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-185e2edd-a576-4a04-acd6-1d6c83a97ee4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:55.668284 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-185e2edd-a576-4a04-acd6-1d6c83a97ee4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:55.669038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-185e2edd-a576-4a04-acd6-1d6c83a97ee4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:55.669468 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-185e2edd-a576-4a04-acd6-1d6c83a97ee4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:55.794560 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-185e2edd-a576-4a04-acd6-1d6c83a97ee4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:55.802850 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-185e2edd-a576-4a04-acd6-1d6c83a97ee4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:55.804374 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-185e2edd-a576-4a04-acd6-1d6c83a97ee4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:55.805495 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-185e2edd-a576-4a04-acd6-1d6c83a97ee4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.148832 Jul 27 04:25:55.806068 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 222/434] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:55 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:55.872225 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-afdee705-03b8-4f47-944e-a80c34eb464a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:55.872825 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-afdee705-03b8-4f47-944e-a80c34eb464a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:55.879232 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-afdee705-03b8-4f47-944e-a80c34eb464a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:55.879670 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-afdee705-03b8-4f47-944e-a80c34eb464a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:55.880422 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-afdee705-03b8-4f47-944e-a80c34eb464a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:55.880854 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-afdee705-03b8-4f47-944e-a80c34eb464a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:56.013365 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-afdee705-03b8-4f47-944e-a80c34eb464a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:56.021323 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-afdee705-03b8-4f47-944e-a80c34eb464a tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.153542 Jul 27 04:25:56.021886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 213/435] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:55 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:56.830712 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-2f9376be-3de8-4876-9d4b-3a4a6b9babf9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:56.831219 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-2f9376be-3de8-4876-9d4b-3a4a6b9babf9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:56.839205 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2f9376be-3de8-4876-9d4b-3a4a6b9babf9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:56.839645 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2f9376be-3de8-4876-9d4b-3a4a6b9babf9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:56.840400 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2f9376be-3de8-4876-9d4b-3a4a6b9babf9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:56.840827 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2f9376be-3de8-4876-9d4b-3a4a6b9babf9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:56.971196 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-2f9376be-3de8-4876-9d4b-3a4a6b9babf9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:56.979476 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-2f9376be-3de8-4876-9d4b-3a4a6b9babf9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:56.980957 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-2f9376be-3de8-4876-9d4b-3a4a6b9babf9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:56.982130 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-2f9376be-3de8-4876-9d4b-3a4a6b9babf9 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.155808 Jul 27 04:25:56.982694 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 223/436] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:56 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:57.042814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d8f79a6d-0052-48b8-a591-cc1427ee5b9e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:57.043419 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d8f79a6d-0052-48b8-a591-cc1427ee5b9e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:57.049916 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d8f79a6d-0052-48b8-a591-cc1427ee5b9e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:57.050401 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d8f79a6d-0052-48b8-a591-cc1427ee5b9e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:57.051163 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d8f79a6d-0052-48b8-a591-cc1427ee5b9e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:57.051596 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d8f79a6d-0052-48b8-a591-cc1427ee5b9e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:57.176259 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d8f79a6d-0052-48b8-a591-cc1427ee5b9e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:57.184224 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d8f79a6d-0052-48b8-a591-cc1427ee5b9e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.145428 Jul 27 04:25:57.184794 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 214/437] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:57 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:58.004819 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a39b0372-d13a-48ec-973a-4c312da09be4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:58.005493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a39b0372-d13a-48ec-973a-4c312da09be4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:58.012539 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a39b0372-d13a-48ec-973a-4c312da09be4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:58.012984 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a39b0372-d13a-48ec-973a-4c312da09be4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:58.014624 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a39b0372-d13a-48ec-973a-4c312da09be4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:58.015238 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a39b0372-d13a-48ec-973a-4c312da09be4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:58.144511 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a39b0372-d13a-48ec-973a-4c312da09be4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:58.153281 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a39b0372-d13a-48ec-973a-4c312da09be4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:58.154791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a39b0372-d13a-48ec-973a-4c312da09be4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:58.155929 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a39b0372-d13a-48ec-973a-4c312da09be4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.155154 Jul 27 04:25:58.156482 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 224/438] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:57 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:58.206277 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-23262d61-7405-4617-8bd2-dbf43cdcac30 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:58.206888 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-23262d61-7405-4617-8bd2-dbf43cdcac30 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:58.213730 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-23262d61-7405-4617-8bd2-dbf43cdcac30 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:58.214206 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-23262d61-7405-4617-8bd2-dbf43cdcac30 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:58.214966 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-23262d61-7405-4617-8bd2-dbf43cdcac30 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:58.215397 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-23262d61-7405-4617-8bd2-dbf43cdcac30 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:58.348590 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-23262d61-7405-4617-8bd2-dbf43cdcac30 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:58.357046 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-23262d61-7405-4617-8bd2-dbf43cdcac30 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.154559 Jul 27 04:25:58.357602 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 215/439] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:58 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:25:59.179932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-27eae393-3ed5-47e6-bdcc-9d4217342958 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:59.180537 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-27eae393-3ed5-47e6-bdcc-9d4217342958 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:59.187035 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-27eae393-3ed5-47e6-bdcc-9d4217342958 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:59.187479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-27eae393-3ed5-47e6-bdcc-9d4217342958 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:59.188243 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-27eae393-3ed5-47e6-bdcc-9d4217342958 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:59.188673 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-27eae393-3ed5-47e6-bdcc-9d4217342958 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:59.329817 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-27eae393-3ed5-47e6-bdcc-9d4217342958 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:59.339005 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-27eae393-3ed5-47e6-bdcc-9d4217342958 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:59.340518 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-27eae393-3ed5-47e6-bdcc-9d4217342958 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:59.341676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-27eae393-3ed5-47e6-bdcc-9d4217342958 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.166508 Jul 27 04:25:59.342275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 225/440] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:25:59 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:25:59.378326 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b10d7c04-3879-414c-b635-04dd6b4e9fed tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:25:59.378927 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-b10d7c04-3879-414c-b635-04dd6b4e9fed tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:25:59.385790 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b10d7c04-3879-414c-b635-04dd6b4e9fed tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:59.386264 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b10d7c04-3879-414c-b635-04dd6b4e9fed tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:59.387018 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b10d7c04-3879-414c-b635-04dd6b4e9fed tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:25:59.387442 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b10d7c04-3879-414c-b635-04dd6b4e9fed tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:25:59.514226 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-b10d7c04-3879-414c-b635-04dd6b4e9fed tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:25:59.521927 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-b10d7c04-3879-414c-b635-04dd6b4e9fed tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.147441 Jul 27 04:25:59.522506 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 216/441] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:25:59 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:00.364667 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-82cf69a1-4e26-4002-a61b-6036cacfd8ed tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:00.365275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-82cf69a1-4e26-4002-a61b-6036cacfd8ed tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:00.372431 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-82cf69a1-4e26-4002-a61b-6036cacfd8ed tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:00.372879 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-82cf69a1-4e26-4002-a61b-6036cacfd8ed tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:00.373631 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-82cf69a1-4e26-4002-a61b-6036cacfd8ed tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:00.374084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-82cf69a1-4e26-4002-a61b-6036cacfd8ed tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:00.503590 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-82cf69a1-4e26-4002-a61b-6036cacfd8ed tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:00.512743 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-82cf69a1-4e26-4002-a61b-6036cacfd8ed tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:00.514288 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-82cf69a1-4e26-4002-a61b-6036cacfd8ed tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:00.515458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-82cf69a1-4e26-4002-a61b-6036cacfd8ed tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.154706 Jul 27 04:26:00.516053 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 226/442] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:00 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:26:00.544037 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-28f4af52-a820-4048-8670-ec8360b05e14 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:00.544640 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-28f4af52-a820-4048-8670-ec8360b05e14 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:00.551047 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-28f4af52-a820-4048-8670-ec8360b05e14 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:00.551489 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-28f4af52-a820-4048-8670-ec8360b05e14 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:00.552241 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-28f4af52-a820-4048-8670-ec8360b05e14 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:00.552671 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-28f4af52-a820-4048-8670-ec8360b05e14 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:00.688482 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-28f4af52-a820-4048-8670-ec8360b05e14 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:00.696793 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-28f4af52-a820-4048-8670-ec8360b05e14 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1735 microversion: 2.1 time: 0.156751 Jul 27 04:26:00.697536 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 217/443] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:00 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:01.538397 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-18057780-8002-43f1-b445-687b0267301c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:01.538909 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-18057780-8002-43f1-b445-687b0267301c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:01.545450 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18057780-8002-43f1-b445-687b0267301c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:01.545894 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18057780-8002-43f1-b445-687b0267301c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:01.546670 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18057780-8002-43f1-b445-687b0267301c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:01.547099 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18057780-8002-43f1-b445-687b0267301c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:01.550887 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=100 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:01.676142 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-18057780-8002-43f1-b445-687b0267301c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:01.684965 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-18057780-8002-43f1-b445-687b0267301c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:01.686488 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-18057780-8002-43f1-b445-687b0267301c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:01.687629 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-18057780-8002-43f1-b445-687b0267301c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.153202 Jul 27 04:26:01.688187 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 227/444] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:01 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:26:01.718695 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d064bf27-ec27-4bba-8033-67f523b968b7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:01.719307 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d064bf27-ec27-4bba-8033-67f523b968b7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:01.725764 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d064bf27-ec27-4bba-8033-67f523b968b7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:01.726252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d064bf27-ec27-4bba-8033-67f523b968b7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:01.727016 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d064bf27-ec27-4bba-8033-67f523b968b7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:01.727451 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d064bf27-ec27-4bba-8033-67f523b968b7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:01.859990 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d064bf27-ec27-4bba-8033-67f523b968b7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:01.867908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d064bf27-ec27-4bba-8033-67f523b968b7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1715 microversion: 2.1 time: 0.152977 Jul 27 04:26:01.868471 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 218/445] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:01 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:01.977108 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a85ac661-9f75-446f-85a7-cb8df7bcac41 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:01.977616 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a85ac661-9f75-446f-85a7-cb8df7bcac41 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:01.983801 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a85ac661-9f75-446f-85a7-cb8df7bcac41 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:01.984255 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a85ac661-9f75-446f-85a7-cb8df7bcac41 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:01.985011 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a85ac661-9f75-446f-85a7-cb8df7bcac41 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:01.985444 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a85ac661-9f75-446f-85a7-cb8df7bcac41 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:02.063742 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-a85ac661-9f75-446f-85a7-cb8df7bcac41 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] HTTP exception thrown: Cannot 'detach_volume' instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d while it is in vm_state rescued Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a85ac661-9f75-446f-85a7-cb8df7bcac41 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Request method failure captured: Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: DELETE /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-volume_attachments/8f4a7c98-5169-43d5-a87c-a1fdac6de475 HTTP/1.1 Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L1Z-GzUdIE10GBth8M9cTTXAKFLlAQub-RLT6WXeUQ2VTjpVcQi9ERrlBs4sOixL-py8Kq_jHt_mJTkFcFxZ2U68zJZmnqGbGiZAMMZ4GJmWWXTF0LUNVT9PhKk7EpB-gN290q8fAEZkyrjCK6yf2Eia0XZsajg3TgawFCUPD4ekpI Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 5bb7f3d2bc1e4651b7f1e0ac6debd89a Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:26:02.065373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:26:02.066799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:26:02.066799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:26:02.066799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 5bb7f3d2bc1e4651b7f1e0ac6debd89a Jul 27 04:26:02.066799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:26:02.066799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-ServerRescueNegativeTestJSON-708246425-project Jul 27 04:26:02.066799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:26:02.066799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:26:02.066799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 5a69202d87094049b12765d64c17e515 Jul 27 04:26:02.066799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-708246425-project Jul 27 04:26:02.066799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:26:02.066799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Cannot 'detach_volume' instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d while it is in vm_state rescued Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'server_id': '1b1166f3-79b8-48f8-87a6-3c6da0593d1d', 'id': '8f4a7c98-5169-43d5-a87c-a1fdac6de475'} Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:26:02.067479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d while it is in vm_state rescued Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d while it is in vm_state rescued Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:02.068983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a85ac661-9f75-446f-85a7-cb8df7bcac41 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Returning 409 to user: Cannot 'detach_volume' instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d while it is in vm_state rescued {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:26:02.070274 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a85ac661-9f75-446f-85a7-cb8df7bcac41 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-volume_attachments/8f4a7c98-5169-43d5-a87c-a1fdac6de475" status: 409 len: 152 microversion: 2.1 time: 0.093719 Jul 27 04:26:02.070274 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 228/446] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Jul 27 04:26:01 2022] DELETE /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-volume_attachments/8f4a7c98-5169-43d5-a87c-a1fdac6de475 => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 27 04:26:02.076582 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0d926513-4204-4adf-b3e6-4f89545cbcee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:26:02.077119 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0d926513-4204-4adf-b3e6-4f89545cbcee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:02.083027 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0d926513-4204-4adf-b3e6-4f89545cbcee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:02.083479 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0d926513-4204-4adf-b3e6-4f89545cbcee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:02.084249 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0d926513-4204-4adf-b3e6-4f89545cbcee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:02.084686 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0d926513-4204-4adf-b3e6-4f89545cbcee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:02.150823 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0d926513-4204-4adf-b3e6-4f89545cbcee tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "POST /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/action" status: 202 len: 0 microversion: 2.1 time: 0.078147 Jul 27 04:26:02.154840 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 219/447] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:26:02 2022] POST /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:26:02.161526 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-40270e98-d126-4453-b21d-70a3a3203bf3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:02.162153 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-40270e98-d126-4453-b21d-70a3a3203bf3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:02.168834 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-40270e98-d126-4453-b21d-70a3a3203bf3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:02.169666 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-40270e98-d126-4453-b21d-70a3a3203bf3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:02.170717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-40270e98-d126-4453-b21d-70a3a3203bf3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:02.171168 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-40270e98-d126-4453-b21d-70a3a3203bf3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:02.303630 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-40270e98-d126-4453-b21d-70a3a3203bf3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:02.312419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-40270e98-d126-4453-b21d-70a3a3203bf3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1723 microversion: 2.1 time: 0.155134 Jul 27 04:26:02.312908 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 229/448] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:02 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:02.712153 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6f091a37-5414-4b6e-8483-ac0962884643 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:02.712889 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6f091a37-5414-4b6e-8483-ac0962884643 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:02.719062 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6f091a37-5414-4b6e-8483-ac0962884643 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:02.720155 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6f091a37-5414-4b6e-8483-ac0962884643 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:02.720922 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6f091a37-5414-4b6e-8483-ac0962884643 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:02.721353 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6f091a37-5414-4b6e-8483-ac0962884643 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:02.839291 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-b27ea101-ea36-4396-8c88-d9b3d6d55296 req-8c26e31d-7206-4c0e-a858-af4adee264f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9478c2cb-a66c-4485-91bf-fe8486025afe", "name": "network-vif-plugged", "status": "completed", "tag": "d905ab8e-bb09-45aa-9436-9f67042c2d1a"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:26:02.849757 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-b27ea101-ea36-4396-8c88-d9b3d6d55296 req-8c26e31d-7206-4c0e-a858-af4adee264f9 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:02.850226 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-b27ea101-ea36-4396-8c88-d9b3d6d55296 req-8c26e31d-7206-4c0e-a858-af4adee264f9 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:02.860691 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6f091a37-5414-4b6e-8483-ac0962884643 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:02.863073 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-b27ea101-ea36-4396-8c88-d9b3d6d55296 req-8c26e31d-7206-4c0e-a858-af4adee264f9 service nova] Creating event network-vif-plugged:d905ab8e-bb09-45aa-9436-9f67042c2d1a for instance 9478c2cb-a66c-4485-91bf-fe8486025afe on hv-cinder-85098 Jul 27 04:26:02.868184 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-b27ea101-ea36-4396-8c88-d9b3d6d55296 req-8c26e31d-7206-4c0e-a858-af4adee264f9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034134 Jul 27 04:26:02.868808 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 230/449] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:26:02.869867 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6f091a37-5414-4b6e-8483-ac0962884643 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:02.871402 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6f091a37-5414-4b6e-8483-ac0962884643 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:02.872610 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6f091a37-5414-4b6e-8483-ac0962884643 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.165780 Jul 27 04:26:02.873161 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 220/450] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:02 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:26:03.334541 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1708e3bb-a2ca-41e5-b1e4-24ee1cb5bc05 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:03.335230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-1708e3bb-a2ca-41e5-b1e4-24ee1cb5bc05 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:03.341712 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1708e3bb-a2ca-41e5-b1e4-24ee1cb5bc05 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:03.342199 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1708e3bb-a2ca-41e5-b1e4-24ee1cb5bc05 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:03.342952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1708e3bb-a2ca-41e5-b1e4-24ee1cb5bc05 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:03.343384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1708e3bb-a2ca-41e5-b1e4-24ee1cb5bc05 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:03.469863 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-1708e3bb-a2ca-41e5-b1e4-24ee1cb5bc05 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:03.477839 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-1708e3bb-a2ca-41e5-b1e4-24ee1cb5bc05 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1723 microversion: 2.1 time: 0.147541 Jul 27 04:26:03.478438 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 231/451] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:03 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:03.895007 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-cf3379e6-acd2-4da7-b575-c22e2bd7da8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:03.896235 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-cf3379e6-acd2-4da7-b575-c22e2bd7da8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:03.903618 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cf3379e6-acd2-4da7-b575-c22e2bd7da8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:03.904080 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cf3379e6-acd2-4da7-b575-c22e2bd7da8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:03.904855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cf3379e6-acd2-4da7-b575-c22e2bd7da8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:03.905293 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cf3379e6-acd2-4da7-b575-c22e2bd7da8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:04.264652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-cf3379e6-acd2-4da7-b575-c22e2bd7da8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:04.273002 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-cf3379e6-acd2-4da7-b575-c22e2bd7da8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:04.274599 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-cf3379e6-acd2-4da7-b575-c22e2bd7da8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:04.275995 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-cf3379e6-acd2-4da7-b575-c22e2bd7da8d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.384828 Jul 27 04:26:04.276566 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 221/452] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:03 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:26:04.499897 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8560287f-4d43-4540-b1be-a181901585b3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:04.500443 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-8560287f-4d43-4540-b1be-a181901585b3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:04.507068 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8560287f-4d43-4540-b1be-a181901585b3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:04.507558 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8560287f-4d43-4540-b1be-a181901585b3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:04.508312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8560287f-4d43-4540-b1be-a181901585b3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:04.508742 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8560287f-4d43-4540-b1be-a181901585b3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:04.641038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-8560287f-4d43-4540-b1be-a181901585b3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:04.648950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8560287f-4d43-4540-b1be-a181901585b3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1729 microversion: 2.1 time: 0.153023 Jul 27 04:26:04.649514 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 232/453] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:04 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:04.669880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c139f75d-f969-4ddc-88ba-1b689ad78eff tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:04.670391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c139f75d-f969-4ddc-88ba-1b689ad78eff tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:04.676372 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c139f75d-f969-4ddc-88ba-1b689ad78eff tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:04.676817 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c139f75d-f969-4ddc-88ba-1b689ad78eff tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:04.677571 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c139f75d-f969-4ddc-88ba-1b689ad78eff tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:04.678014 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c139f75d-f969-4ddc-88ba-1b689ad78eff tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:04.757214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c139f75d-f969-4ddc-88ba-1b689ad78eff tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091615 Jul 27 04:26:04.758016 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 222/454] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Jul 27 04:26:04 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:26:05.299423 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-32eb9dfc-7d6d-4f92-a2fe-c16c738a1806 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:05.300026 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-32eb9dfc-7d6d-4f92-a2fe-c16c738a1806 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:05.306092 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-32eb9dfc-7d6d-4f92-a2fe-c16c738a1806 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:05.307084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-32eb9dfc-7d6d-4f92-a2fe-c16c738a1806 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:05.307444 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-32eb9dfc-7d6d-4f92-a2fe-c16c738a1806 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:05.307873 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-32eb9dfc-7d6d-4f92-a2fe-c16c738a1806 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:05.529653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-32eb9dfc-7d6d-4f92-a2fe-c16c738a1806 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:05.538039 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-32eb9dfc-7d6d-4f92-a2fe-c16c738a1806 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:05.539548 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-32eb9dfc-7d6d-4f92-a2fe-c16c738a1806 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:05.540789 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-32eb9dfc-7d6d-4f92-a2fe-c16c738a1806 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.245271 Jul 27 04:26:05.541569 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 233/455] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:05 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:26:05.691549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-4a0339b6-0be2-4df1-9e6a-08331e825067 req-f574ee44-0727-4da7-a808-8b1505ae44bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1166f3-79b8-48f8-87a6-3c6da0593d1d", "tag": "07a12d67-caf1-42ba-a028-b0c5a40a4a5e"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:26:05.702423 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-4a0339b6-0be2-4df1-9e6a-08331e825067 req-f574ee44-0727-4da7-a808-8b1505ae44bd service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:05.702969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-4a0339b6-0be2-4df1-9e6a-08331e825067 req-f574ee44-0727-4da7-a808-8b1505ae44bd service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:05.715528 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-4a0339b6-0be2-4df1-9e6a-08331e825067 req-f574ee44-0727-4da7-a808-8b1505ae44bd service nova] Creating event network-changed:07a12d67-caf1-42ba-a028-b0c5a40a4a5e for instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d on hv-cinder-85098 Jul 27 04:26:05.722477 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-4a0339b6-0be2-4df1-9e6a-08331e825067 req-f574ee44-0727-4da7-a808-8b1505ae44bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034998 Jul 27 04:26:05.723075 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 223/456] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:26:06.564954 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a7aa6ee4-64cb-4762-b3d8-04693f5a961e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:06.565492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a7aa6ee4-64cb-4762-b3d8-04693f5a961e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:06.576350 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a7aa6ee4-64cb-4762-b3d8-04693f5a961e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:06.577202 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a7aa6ee4-64cb-4762-b3d8-04693f5a961e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:06.578340 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a7aa6ee4-64cb-4762-b3d8-04693f5a961e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:06.578929 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a7aa6ee4-64cb-4762-b3d8-04693f5a961e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:06.723936 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a7aa6ee4-64cb-4762-b3d8-04693f5a961e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:06.732945 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a7aa6ee4-64cb-4762-b3d8-04693f5a961e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:06.734487 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a7aa6ee4-64cb-4762-b3d8-04693f5a961e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:06.735642 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a7aa6ee4-64cb-4762-b3d8-04693f5a961e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1808 microversion: 2.20 time: 0.174636 Jul 27 04:26:06.736236 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 234/457] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:06 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:26:07.737959 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-08e661ab-6bad-4ebe-9c1f-83f4711c365e req-edfe5254-9ec5-4482-91ea-681a6c38ab76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1166f3-79b8-48f8-87a6-3c6da0593d1d", "tag": "07a12d67-caf1-42ba-a028-b0c5a40a4a5e"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:26:07.748491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-08e661ab-6bad-4ebe-9c1f-83f4711c365e req-edfe5254-9ec5-4482-91ea-681a6c38ab76 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:07.748929 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-08e661ab-6bad-4ebe-9c1f-83f4711c365e req-edfe5254-9ec5-4482-91ea-681a6c38ab76 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:07.758843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-de80b4c8-5d3c-43c6-ba13-8f9aaed6e172 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:07.759453 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-de80b4c8-5d3c-43c6-ba13-8f9aaed6e172 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:07.759582 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-08e661ab-6bad-4ebe-9c1f-83f4711c365e req-edfe5254-9ec5-4482-91ea-681a6c38ab76 service nova] Creating event network-changed:07a12d67-caf1-42ba-a028-b0c5a40a4a5e for instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d on hv-cinder-85098 Jul 27 04:26:07.764636 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-08e661ab-6bad-4ebe-9c1f-83f4711c365e req-edfe5254-9ec5-4482-91ea-681a6c38ab76 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031181 Jul 27 04:26:07.765239 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 224/458] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:26:07.767180 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-de80b4c8-5d3c-43c6-ba13-8f9aaed6e172 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:07.767631 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-de80b4c8-5d3c-43c6-ba13-8f9aaed6e172 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:07.768400 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-de80b4c8-5d3c-43c6-ba13-8f9aaed6e172 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:07.768833 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-de80b4c8-5d3c-43c6-ba13-8f9aaed6e172 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:07.901393 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-de80b4c8-5d3c-43c6-ba13-8f9aaed6e172 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:07.910361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-de80b4c8-5d3c-43c6-ba13-8f9aaed6e172 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:07.911897 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-de80b4c8-5d3c-43c6-ba13-8f9aaed6e172 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:07.913087 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-de80b4c8-5d3c-43c6-ba13-8f9aaed6e172 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1795 microversion: 2.20 time: 0.158118 Jul 27 04:26:07.913655 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 235/459] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:07 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:26:38.108989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=29 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:38.109729 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:38.114421 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ab53788e-3309-421e-af28-81293b445447 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:38.115042 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ab53788e-3309-421e-af28-81293b445447 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:38.122506 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ab53788e-3309-421e-af28-81293b445447 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:38.122960 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ab53788e-3309-421e-af28-81293b445447 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:38.123726 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ab53788e-3309-421e-af28-81293b445447 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:38.124162 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ab53788e-3309-421e-af28-81293b445447 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:38.208697 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.objects.instance [None req-ab53788e-3309-421e-af28-81293b445447 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lazy-loading 'services' on Instance uuid 1b1166f3-79b8-48f8-87a6-3c6da0593d1d {{(pid=117739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:26:38.279693 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ab53788e-3309-421e-af28-81293b445447 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-volume_attachments/8f4a7c98-5169-43d5-a87c-a1fdac6de475" status: 202 len: 0 microversion: 2.1 time: 0.172246 Jul 27 04:26:38.280284 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 225/460] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Jul 27 04:26:38 2022] DELETE /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-volume_attachments/8f4a7c98-5169-43d5-a87c-a1fdac6de475 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:26:38.288940 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-50dc7000-d6a6-4f9f-8621-a870d98cb4b9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:38.291249 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-50dc7000-d6a6-4f9f-8621-a870d98cb4b9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:38.293510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=33 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:38.294701 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=49 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:38.301468 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-50dc7000-d6a6-4f9f-8621-a870d98cb4b9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:38.301866 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-50dc7000-d6a6-4f9f-8621-a870d98cb4b9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:38.302929 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-50dc7000-d6a6-4f9f-8621-a870d98cb4b9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:38.303398 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-50dc7000-d6a6-4f9f-8621-a870d98cb4b9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:38.335434 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-50dc7000-d6a6-4f9f-8621-a870d98cb4b9 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050647 Jul 27 04:26:38.335982 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 236/461] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:26:38 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:26:39.057126 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 04:26:39.057329 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Wed Jul 27 04:26:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 04:26:39.349774 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ec11a564-8b44-435a-aabd-280ebce08e06 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:39.352101 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ec11a564-8b44-435a-aabd-280ebce08e06 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:39.360303 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ec11a564-8b44-435a-aabd-280ebce08e06 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:39.360749 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ec11a564-8b44-435a-aabd-280ebce08e06 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:39.361502 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ec11a564-8b44-435a-aabd-280ebce08e06 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:39.361935 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ec11a564-8b44-435a-aabd-280ebce08e06 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:39.389929 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ec11a564-8b44-435a-aabd-280ebce08e06 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044877 Jul 27 04:26:39.390494 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 226/462] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:26:39 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 04:26:39.464416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0db141ff-e1a6-4256-9055-c9c3aa25776d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:39.465416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0db141ff-e1a6-4256-9055-c9c3aa25776d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:39.471885 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0db141ff-e1a6-4256-9055-c9c3aa25776d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:39.472326 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0db141ff-e1a6-4256-9055-c9c3aa25776d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:39.473084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0db141ff-e1a6-4256-9055-c9c3aa25776d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:39.473512 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0db141ff-e1a6-4256-9055-c9c3aa25776d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:39.498125 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0db141ff-e1a6-4256-9055-c9c3aa25776d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Going to try to terminate instance {{(pid=117740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:26:39.571255 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0db141ff-e1a6-4256-9055-c9c3aa25776d tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 204 len: 0 microversion: 2.1 time: 0.110655 Jul 27 04:26:39.572109 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 237/463] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:26:39 2022] DELETE /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:26:39.581139 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2124dc9a-b17c-4e25-b2e6-7bcb232cec8c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:39.581837 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2124dc9a-b17c-4e25-b2e6-7bcb232cec8c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:39.587704 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2124dc9a-b17c-4e25-b2e6-7bcb232cec8c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:39.588154 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2124dc9a-b17c-4e25-b2e6-7bcb232cec8c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:39.588917 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2124dc9a-b17c-4e25-b2e6-7bcb232cec8c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:39.589502 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2124dc9a-b17c-4e25-b2e6-7bcb232cec8c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:39.870838 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2124dc9a-b17c-4e25-b2e6-7bcb232cec8c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:39.878385 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2124dc9a-b17c-4e25-b2e6-7bcb232cec8c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1689 microversion: 2.1 time: 0.301575 Jul 27 04:26:39.878883 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 227/464] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:39 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1689 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:40.900039 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-165e2ed4-306f-4c03-8d77-7d5ae937bfac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:40.900767 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-165e2ed4-306f-4c03-8d77-7d5ae937bfac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:40.907554 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-165e2ed4-306f-4c03-8d77-7d5ae937bfac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:40.907997 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-165e2ed4-306f-4c03-8d77-7d5ae937bfac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:40.908756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-165e2ed4-306f-4c03-8d77-7d5ae937bfac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:40.909187 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-165e2ed4-306f-4c03-8d77-7d5ae937bfac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:41.037570 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8af46255-3e27-4f67-b0e5-735bbd8626c0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:41.038164 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8af46255-3e27-4f67-b0e5-735bbd8626c0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:41.044533 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8af46255-3e27-4f67-b0e5-735bbd8626c0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:41.044986 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8af46255-3e27-4f67-b0e5-735bbd8626c0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:41.045762 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8af46255-3e27-4f67-b0e5-735bbd8626c0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:41.046225 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8af46255-3e27-4f67-b0e5-735bbd8626c0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:41.075882 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8af46255-3e27-4f67-b0e5-735bbd8626c0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments/3d677366-6d4f-4e3c-a8f2-64da03c246cc" status: 200 len: 194 microversion: 2.20 time: 0.042347 Jul 27 04:26:41.076479 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 228/465] 10.222.0.46 () {60 vars in 1454 bytes} [Wed Jul 27 04:26:41 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments/3d677366-6d4f-4e3c-a8f2-64da03c246cc => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 04:26:41.100520 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-165e2ed4-306f-4c03-8d77-7d5ae937bfac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:41.108522 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-165e2ed4-306f-4c03-8d77-7d5ae937bfac tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1689 microversion: 2.1 time: 0.212707 Jul 27 04:26:41.109102 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 238/466] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:40 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1689 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:41.145618 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b484f89c-b6ee-4c39-b852-8c2697f46f69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:41.146140 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-b484f89c-b6ee-4c39-b852-8c2697f46f69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:41.152078 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b484f89c-b6ee-4c39-b852-8c2697f46f69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:41.152458 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b484f89c-b6ee-4c39-b852-8c2697f46f69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:41.153229 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b484f89c-b6ee-4c39-b852-8c2697f46f69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:41.153656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b484f89c-b6ee-4c39-b852-8c2697f46f69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:41.231273 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.objects.instance [None req-b484f89c-b6ee-4c39-b852-8c2697f46f69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lazy-loading 'services' on Instance uuid 9478c2cb-a66c-4485-91bf-fe8486025afe {{(pid=117739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:26:41.308918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-b484f89c-b6ee-4c39-b852-8c2697f46f69 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments/3d677366-6d4f-4e3c-a8f2-64da03c246cc" status: 202 len: 0 microversion: 2.20 time: 0.166032 Jul 27 04:26:41.309574 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 229/467] 10.222.0.46 () {60 vars in 1457 bytes} [Wed Jul 27 04:26:41 2022] DELETE /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments/3d677366-6d4f-4e3c-a8f2-64da03c246cc => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:26:41.318389 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-68b37a5d-8523-4ab3-a8ba-0acb4468c514 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:41.321252 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-68b37a5d-8523-4ab3-a8ba-0acb4468c514 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:41.327524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-68b37a5d-8523-4ab3-a8ba-0acb4468c514 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:41.327978 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-68b37a5d-8523-4ab3-a8ba-0acb4468c514 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:41.328748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-68b37a5d-8523-4ab3-a8ba-0acb4468c514 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:41.329194 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-68b37a5d-8523-4ab3-a8ba-0acb4468c514 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:41.360187 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-68b37a5d-8523-4ab3-a8ba-0acb4468c514 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045751 Jul 27 04:26:41.360748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 239/468] 10.222.0.46 () {60 vars in 1343 bytes} [Wed Jul 27 04:26:41 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:26:42.131057 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-bd319ff1-9663-4cef-8f6c-b4f169a78907 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:42.131762 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-bd319ff1-9663-4cef-8f6c-b4f169a78907 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:42.139202 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bd319ff1-9663-4cef-8f6c-b4f169a78907 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:42.139652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bd319ff1-9663-4cef-8f6c-b4f169a78907 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:42.140419 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bd319ff1-9663-4cef-8f6c-b4f169a78907 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:42.140858 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bd319ff1-9663-4cef-8f6c-b4f169a78907 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:42.270292 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-bd319ff1-9663-4cef-8f6c-b4f169a78907 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:42.278308 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-bd319ff1-9663-4cef-8f6c-b4f169a78907 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1689 microversion: 2.1 time: 0.151667 Jul 27 04:26:42.278877 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 230/469] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:42 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:42.373070 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0816f48c-a16b-4464-912f-d5edfc29bfe1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:42.375231 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0816f48c-a16b-4464-912f-d5edfc29bfe1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:42.381693 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0816f48c-a16b-4464-912f-d5edfc29bfe1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:42.382128 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0816f48c-a16b-4464-912f-d5edfc29bfe1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:42.382893 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0816f48c-a16b-4464-912f-d5edfc29bfe1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:42.383331 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0816f48c-a16b-4464-912f-d5edfc29bfe1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:42.412376 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0816f48c-a16b-4464-912f-d5edfc29bfe1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043985 Jul 27 04:26:42.412921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 240/470] 10.222.0.46 () {60 vars in 1343 bytes} [Wed Jul 27 04:26:42 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:26:43.300037 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ac9bafa3-6eea-4557-a6b4-a9708350beb1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:43.300641 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ac9bafa3-6eea-4557-a6b4-a9708350beb1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:43.306660 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ac9bafa3-6eea-4557-a6b4-a9708350beb1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:43.307140 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ac9bafa3-6eea-4557-a6b4-a9708350beb1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:43.308097 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ac9bafa3-6eea-4557-a6b4-a9708350beb1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:43.308589 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ac9bafa3-6eea-4557-a6b4-a9708350beb1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:43.424877 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-02bdffb9-de13-4b2e-b38d-0fbfaaf5def1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:43.427170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-02bdffb9-de13-4b2e-b38d-0fbfaaf5def1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:43.433297 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-02bdffb9-de13-4b2e-b38d-0fbfaaf5def1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:43.433737 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-02bdffb9-de13-4b2e-b38d-0fbfaaf5def1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:43.434525 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-02bdffb9-de13-4b2e-b38d-0fbfaaf5def1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:43.434958 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-02bdffb9-de13-4b2e-b38d-0fbfaaf5def1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:43.468330 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-02bdffb9-de13-4b2e-b38d-0fbfaaf5def1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047415 Jul 27 04:26:43.473987 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 241/471] 10.222.0.46 () {60 vars in 1343 bytes} [Wed Jul 27 04:26:43 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 04:26:43.574075 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ac9bafa3-6eea-4557-a6b4-a9708350beb1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:43.582120 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ac9bafa3-6eea-4557-a6b4-a9708350beb1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1689 microversion: 2.1 time: 0.286389 Jul 27 04:26:43.582875 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 231/472] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:43 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1689 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:44.341138 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-55af1e0b-9677-4408-b0f9-904eaf75a067 req-89e16d90-74cf-40b3-9f20-938f42d2616b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1166f3-79b8-48f8-87a6-3c6da0593d1d", "name": "network-vif-deleted", "tag": "07a12d67-caf1-42ba-a028-b0c5a40a4a5e"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:26:44.351939 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-55af1e0b-9677-4408-b0f9-904eaf75a067 req-89e16d90-74cf-40b3-9f20-938f42d2616b service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:44.353265 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-55af1e0b-9677-4408-b0f9-904eaf75a067 req-89e16d90-74cf-40b3-9f20-938f42d2616b service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:44.373514 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-55af1e0b-9677-4408-b0f9-904eaf75a067 req-89e16d90-74cf-40b3-9f20-938f42d2616b service nova] Creating event network-vif-deleted:07a12d67-caf1-42ba-a028-b0c5a40a4a5e for instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d on hv-cinder-85098 Jul 27 04:26:44.378605 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-55af1e0b-9677-4408-b0f9-904eaf75a067 req-89e16d90-74cf-40b3-9f20-938f42d2616b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041528 Jul 27 04:26:44.379799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 242/473] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:26:44.482443 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e7e25431-a924-4c53-a4b2-e4a3b32e956b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:44.485142 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e7e25431-a924-4c53-a4b2-e4a3b32e956b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:44.491945 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e7e25431-a924-4c53-a4b2-e4a3b32e956b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:44.492468 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e7e25431-a924-4c53-a4b2-e4a3b32e956b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:44.493302 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e7e25431-a924-4c53-a4b2-e4a3b32e956b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:44.493808 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e7e25431-a924-4c53-a4b2-e4a3b32e956b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:44.523713 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e7e25431-a924-4c53-a4b2-e4a3b32e956b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046761 Jul 27 04:26:44.524311 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 232/474] 10.222.0.46 () {60 vars in 1343 bytes} [Wed Jul 27 04:26:44 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:44.590594 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d6af57a1-e911-4bb8-8038-e0d1007b48d6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:44.591245 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d6af57a1-e911-4bb8-8038-e0d1007b48d6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:44.597812 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d6af57a1-e911-4bb8-8038-e0d1007b48d6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:44.598459 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d6af57a1-e911-4bb8-8038-e0d1007b48d6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:44.599491 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d6af57a1-e911-4bb8-8038-e0d1007b48d6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:44.600114 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d6af57a1-e911-4bb8-8038-e0d1007b48d6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:44.603920 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9c606e86-48e7-47e6-938b-93ae4324b97e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:44.606118 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9c606e86-48e7-47e6-938b-93ae4324b97e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:44.613106 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9c606e86-48e7-47e6-938b-93ae4324b97e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:44.613775 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9c606e86-48e7-47e6-938b-93ae4324b97e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:44.614947 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9c606e86-48e7-47e6-938b-93ae4324b97e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:44.615842 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9c606e86-48e7-47e6-938b-93ae4324b97e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:44.629679 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d6af57a1-e911-4bb8-8038-e0d1007b48d6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Going to try to terminate instance {{(pid=117740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:26:44.656315 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9c606e86-48e7-47e6-938b-93ae4324b97e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:44.657061 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9c606e86-48e7-47e6-938b-93ae4324b97e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:44.657635 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.objects.instance [None req-9c606e86-48e7-47e6-938b-93ae4324b97e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lazy-loading 'fault' on Instance uuid 1b1166f3-79b8-48f8-87a6-3c6da0593d1d {{(pid=117739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:26:44.726284 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9c606e86-48e7-47e6-938b-93ae4324b97e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:44.739807 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9c606e86-48e7-47e6-938b-93ae4324b97e tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1335 microversion: 2.1 time: 0.139775 Jul 27 04:26:44.753018 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 233/475] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:44 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1335 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:44.769372 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d6af57a1-e911-4bb8-8038-e0d1007b48d6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 204 len: 0 microversion: 2.20 time: 0.183152 Jul 27 04:26:44.770382 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 243/476] 10.222.0.46 () {60 vars in 1280 bytes} [Wed Jul 27 04:26:44 2022] DELETE /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 04:26:44.781465 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6eda707e-f1c0-4563-bf22-dc3d8d9d45e2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:44.782387 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6eda707e-f1c0-4563-bf22-dc3d8d9d45e2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:44.791227 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6eda707e-f1c0-4563-bf22-dc3d8d9d45e2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:44.791909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6eda707e-f1c0-4563-bf22-dc3d8d9d45e2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:44.793360 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6eda707e-f1c0-4563-bf22-dc3d8d9d45e2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:44.794168 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6eda707e-f1c0-4563-bf22-dc3d8d9d45e2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:44.936447 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6eda707e-f1c0-4563-bf22-dc3d8d9d45e2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:44.944523 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6eda707e-f1c0-4563-bf22-dc3d8d9d45e2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:44.946293 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6eda707e-f1c0-4563-bf22-dc3d8d9d45e2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:44.947453 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6eda707e-f1c0-4563-bf22-dc3d8d9d45e2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.172369 Jul 27 04:26:44.948006 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 234/477] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:44 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:26:45.765327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-234f8782-d1fd-4609-9222-ab9e335cf6ca tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:45.766085 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-234f8782-d1fd-4609-9222-ab9e335cf6ca tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:45.772887 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-234f8782-d1fd-4609-9222-ab9e335cf6ca tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:45.773340 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-234f8782-d1fd-4609-9222-ab9e335cf6ca tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:45.774158 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-234f8782-d1fd-4609-9222-ab9e335cf6ca tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:45.774598 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-234f8782-d1fd-4609-9222-ab9e335cf6ca tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:45.805444 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-234f8782-d1fd-4609-9222-ab9e335cf6ca tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:45.805899 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-234f8782-d1fd-4609-9222-ab9e335cf6ca tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:45.806379 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-234f8782-d1fd-4609-9222-ab9e335cf6ca tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lazy-loading 'fault' on Instance uuid 1b1166f3-79b8-48f8-87a6-3c6da0593d1d {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:26:45.851440 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-234f8782-d1fd-4609-9222-ab9e335cf6ca tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:45.859581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-234f8782-d1fd-4609-9222-ab9e335cf6ca tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 200 len: 1335 microversion: 2.1 time: 0.098728 Jul 27 04:26:45.860154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 244/478] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:45 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 1335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:45.971700 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-01f307e5-1c9e-4752-bd96-c57370b0570d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:45.972244 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-01f307e5-1c9e-4752-bd96-c57370b0570d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:45.982619 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-01f307e5-1c9e-4752-bd96-c57370b0570d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:45.982988 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-01f307e5-1c9e-4752-bd96-c57370b0570d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:45.983794 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-01f307e5-1c9e-4752-bd96-c57370b0570d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:45.984221 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-01f307e5-1c9e-4752-bd96-c57370b0570d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:46.112219 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-01f307e5-1c9e-4752-bd96-c57370b0570d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:46.120048 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-01f307e5-1c9e-4752-bd96-c57370b0570d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:46.121535 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-01f307e5-1c9e-4752-bd96-c57370b0570d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:46.122701 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-01f307e5-1c9e-4752-bd96-c57370b0570d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1723 microversion: 2.20 time: 0.155195 Jul 27 04:26:46.123446 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 235/479] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:45 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:26:46.939064 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-168e5c1a-24fa-4aad-aac3-4a47fc0f967c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:46.939630 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-168e5c1a-24fa-4aad-aac3-4a47fc0f967c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 1b1166f3-79b8-48f8-87a6-3c6da0593d1d] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:46.946970 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-168e5c1a-24fa-4aad-aac3-4a47fc0f967c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:46.947412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-168e5c1a-24fa-4aad-aac3-4a47fc0f967c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:46.948315 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-168e5c1a-24fa-4aad-aac3-4a47fc0f967c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:46.949307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-168e5c1a-24fa-4aad-aac3-4a47fc0f967c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:46.962691 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-168e5c1a-24fa-4aad-aac3-4a47fc0f967c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] HTTP exception thrown: Instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d could not be found. Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-168e5c1a-24fa-4aad-aac3-4a47fc0f967c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Request method failure captured: Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d HTTP/1.1 Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L1Z-GzUdIE10GBth8M9cTTXAKFLlAQub-RLT6WXeUQ2VTjpVcQi9ERrlBs4sOixL-py8Kq_jHt_mJTkFcFxZ2U68zJZmnqGbGiZAMMZ4GJmWWXTF0LUNVT9PhKk7EpB-gN290q8fAEZkyrjCK6yf2Eia0XZsajg3TgawFCUPD4ekpI Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 5bb7f3d2bc1e4651b7f1e0ac6debd89a Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:26:46.964327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:26:46.966052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:26:46.966052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:26:46.966052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 5bb7f3d2bc1e4651b7f1e0ac6debd89a Jul 27 04:26:46.966052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:26:46.966052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-ServerRescueNegativeTestJSON-708246425-project Jul 27 04:26:46.966052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:26:46.966052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:26:46.966052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 5a69202d87094049b12765d64c17e515 Jul 27 04:26:46.966052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-708246425-project Jul 27 04:26:46.966052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:26:46.966052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d could not be found. Jul 27 04:26:46.966052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '1b1166f3-79b8-48f8-87a6-3c6da0593d1d'} Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d could not be found. Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:26:46.966949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d could not be found. Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d could not be found. Jul 27 04:26:46.968429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:46.970107 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-168e5c1a-24fa-4aad-aac3-4a47fc0f967c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Returning 404 to user: Instance 1b1166f3-79b8-48f8-87a6-3c6da0593d1d could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:26:46.970107 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-168e5c1a-24fa-4aad-aac3-4a47fc0f967c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d" status: 404 len: 111 microversion: 2.1 time: 0.088935 Jul 27 04:26:46.970107 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 245/480] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:46 2022] GET /compute/v2.1/servers/1b1166f3-79b8-48f8-87a6-3c6da0593d1d => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:26:46.974954 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-971d8b59-9f64-4705-8d97-54e190d203bf tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '.version_select at 0x7f21d80c69d0>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:47.000479 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-971d8b59-9f64-4705-8d97-54e190d203bf tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1727557744" status: 202 len: 0 microversion: 2.1 time: 0.029614 Jul 27 04:26:47.001400 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 236/481] 10.222.0.46 () {58 vars in 1221 bytes} [Wed Jul 27 04:26:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1727557744 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:26:47.145250 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-185faa83-4ae6-4cbd-ad63-5ec42fc128bd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:47.145860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-185faa83-4ae6-4cbd-ad63-5ec42fc128bd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:47.155291 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-185faa83-4ae6-4cbd-ad63-5ec42fc128bd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:47.156125 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-185faa83-4ae6-4cbd-ad63-5ec42fc128bd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:47.157135 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-185faa83-4ae6-4cbd-ad63-5ec42fc128bd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:47.157724 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-185faa83-4ae6-4cbd-ad63-5ec42fc128bd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:47.274804 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-185faa83-4ae6-4cbd-ad63-5ec42fc128bd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:47.283290 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-185faa83-4ae6-4cbd-ad63-5ec42fc128bd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:47.284780 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-185faa83-4ae6-4cbd-ad63-5ec42fc128bd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:47.285924 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-185faa83-4ae6-4cbd-ad63-5ec42fc128bd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 200 len: 1655 microversion: 2.20 time: 0.144589 Jul 27 04:26:47.286700 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 246/482] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:47 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 1655 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:26:47.682701 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-26402bd7-b96d-4800-acfd-42578352ec2e req-9b5716df-86ca-47d0-a408-63cd56d54b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9478c2cb-a66c-4485-91bf-fe8486025afe", "name": "network-vif-deleted", "tag": "d905ab8e-bb09-45aa-9436-9f67042c2d1a"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:26:47.695892 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-26402bd7-b96d-4800-acfd-42578352ec2e req-9b5716df-86ca-47d0-a408-63cd56d54b86 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:47.696983 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-26402bd7-b96d-4800-acfd-42578352ec2e req-9b5716df-86ca-47d0-a408-63cd56d54b86 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:47.709250 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-26402bd7-b96d-4800-acfd-42578352ec2e req-9b5716df-86ca-47d0-a408-63cd56d54b86 service nova] Creating event network-vif-deleted:d905ab8e-bb09-45aa-9436-9f67042c2d1a for instance 9478c2cb-a66c-4485-91bf-fe8486025afe on hv-cinder-85098 Jul 27 04:26:47.716202 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-26402bd7-b96d-4800-acfd-42578352ec2e req-9b5716df-86ca-47d0-a408-63cd56d54b86 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036994 Jul 27 04:26:47.717582 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 237/483] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:26:48.310841 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-411f8ea3-ac8a-4c93-a3ad-70d1121a2035 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:48.311549 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-411f8ea3-ac8a-4c93-a3ad-70d1121a2035 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:48.318632 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-411f8ea3-ac8a-4c93-a3ad-70d1121a2035 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:48.319155 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-411f8ea3-ac8a-4c93-a3ad-70d1121a2035 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:48.320001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-411f8ea3-ac8a-4c93-a3ad-70d1121a2035 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:48.320442 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-411f8ea3-ac8a-4c93-a3ad-70d1121a2035 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:48.336249 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-411f8ea3-ac8a-4c93-a3ad-70d1121a2035 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] HTTP exception thrown: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-411f8ea3-ac8a-4c93-a3ad-70d1121a2035 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Request method failure captured: Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe HTTP/1.1 Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L22tU-MfLyltm-qEQwO0vWbGKtUxKRm9tAeZac2tHlreoab-rx5nclncfPbzo9ADYZQeKvX9imPi3uB6iOUc4a2As6lIZ7y1QKROohNpUNbO_7mLM_qmUMteiaWwljji0YGBU0miMCgxOt1GXRxBbLzOvuy1aJejEMKOuYVjH41Isg Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 243e75013f5f49e88df72564ac0d2fe7 Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:26:48.337785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:26:48.339653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:26:48.339653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:26:48.339653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 243e75013f5f49e88df72564ac0d2fe7 Jul 27 04:26:48.339653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:26:48.339653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeShelveTestJSON-1869080554-project Jul 27 04:26:48.339653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:26:48.339653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:26:48.339653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 0eaa342a6bc84529a5d252c7a9a161ba Jul 27 04:26:48.339653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1869080554-project Jul 27 04:26:48.339653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:26:48.339653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:26:48.339653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '9478c2cb-a66c-4485-91bf-fe8486025afe'} Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:26:48.340566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:26:48.341916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:48.343170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-411f8ea3-ac8a-4c93-a3ad-70d1121a2035 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Returning 404 to user: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:26:48.343170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-411f8ea3-ac8a-4c93-a3ad-70d1121a2035 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 404 len: 111 microversion: 2.20 time: 0.033178 Jul 27 04:26:48.343170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 247/484] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:48 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 04:26:48.349829 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-16f05866-e7cc-4df1-8277-4cbf7670788b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '.version_select at 0x7f21d5bbe4c0>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:48.368442 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-16f05866-e7cc-4df1-8277-4cbf7670788b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044162052" status: 204 len: 0 microversion: 2.20 time: 0.023327 Jul 27 04:26:48.369075 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 238/485] 10.222.0.46 () {60 vars in 1262 bytes} [Wed Jul 27 04:26:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044162052 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 04:26:49.015657 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-63b92faf-3b0f-4763-b8d4-22a0fee6767d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Action: 'create', calling method: .version_select at 0x7f21d5b8bee0>, body: {"keypair": {"name": "tempest-keypair-172792172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARJLW64Iv4yL1SxI9beLO2TlkRr/R52h9lDZEMYBOGHPGr42DcVCf+8mQ0X5e//IED7uOCazbyWel7gOQALfuXCSHSYiW30CipbfCJ7Q9cyLU1LmGukZvttq5l7xWtUdQ=="}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:26:49.031525 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-63b92faf-3b0f-4763-b8d4-22a0fee6767d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Getting quotas for project 243e75013f5f49e88df72564ac0d2fe7. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:26:49.035333 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-63b92faf-3b0f-4763-b8d4-22a0fee6767d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Getting quotas for user 0eaa342a6bc84529a5d252c7a9a161ba and project 243e75013f5f49e88df72564ac0d2fe7. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:26:49.060765 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-63b92faf-3b0f-4763-b8d4-22a0fee6767d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048995 Jul 27 04:26:49.061577 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 248/486] 10.222.0.46 () {62 vars in 1200 bytes} [Wed Jul 27 04:26:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 27 04:26:50.191571 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-14572ff2-e16b-474a-9dc3-9b78c3fe2420 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:50.192265 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-14572ff2-e16b-474a-9dc3-9b78c3fe2420 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:50.199616 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-14572ff2-e16b-474a-9dc3-9b78c3fe2420 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:50.200134 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-14572ff2-e16b-474a-9dc3-9b78c3fe2420 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:50.200966 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-14572ff2-e16b-474a-9dc3-9b78c3fe2420 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:50.201426 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-14572ff2-e16b-474a-9dc3-9b78c3fe2420 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:50.226713 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-14572ff2-e16b-474a-9dc3-9b78c3fe2420 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Going to try to terminate instance {{(pid=117739) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:26:50.306351 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-14572ff2-e16b-474a-9dc3-9b78c3fe2420 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "DELETE /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 204 len: 0 microversion: 2.1 time: 0.118701 Jul 27 04:26:50.307023 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 239/487] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:26:50 2022] DELETE /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:26:50.316219 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4049f196-3695-435b-bba7-34e7a4f126c7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:50.316844 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4049f196-3695-435b-bba7-34e7a4f126c7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:50.324459 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4049f196-3695-435b-bba7-34e7a4f126c7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:50.324913 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4049f196-3695-435b-bba7-34e7a4f126c7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:50.325687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4049f196-3695-435b-bba7-34e7a4f126c7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:50.326189 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4049f196-3695-435b-bba7-34e7a4f126c7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:50.341687 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-846110080", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1955f4b1-9680-4302-bec5-883bf41fbdb1"}], "security_groups": [{"name": "tempest-securitygroup--784136834"}], "key_name": "tempest-keypair-172792172", "user_data": "}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:26:50.444473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] validate_networks() for [('1955f4b1-9680-4302-bec5-883bf41fbdb1', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:26:50.459974 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4049f196-3695-435b-bba7-34e7a4f126c7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:50.473924 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4049f196-3695-435b-bba7-34e7a4f126c7 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1507 microversion: 2.1 time: 0.161712 Jul 27 04:26:50.474554 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 249/488] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:50 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:50.851995 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:26:50.852447 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:26:50.852919 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:26:50.853320 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:26:50.853725 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:26:50.863303 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:50.863747 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:50.864537 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:50.864968 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:50.881532 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Getting quotas for project 243e75013f5f49e88df72564ac0d2fe7. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:26:50.885461 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Getting quotas for user 0eaa342a6bc84529a5d252c7a9a161ba and project 243e75013f5f49e88df72564ac0d2fe7. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:26:50.896861 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:26:50.899125 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:26:50.945704 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-bcfb4db8-3eb6-4d16-8631-2e371a04f5ea tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.608933 Jul 27 04:26:50.946666 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 240/489] 10.222.0.46 () {62 vars in 1188 bytes} [Wed Jul 27 04:26:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 27 04:26:50.958016 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e2bb8efc-1872-4f8e-947c-44c71da2236c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:50.958631 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e2bb8efc-1872-4f8e-947c-44c71da2236c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:51.014951 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e2bb8efc-1872-4f8e-947c-44c71da2236c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:51.022448 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e2bb8efc-1872-4f8e-947c-44c71da2236c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:51.023956 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e2bb8efc-1872-4f8e-947c-44c71da2236c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:51.025065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e2bb8efc-1872-4f8e-947c-44c71da2236c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1280 microversion: 2.20 time: 0.070930 Jul 27 04:26:51.025619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 250/490] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:50 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:26:51.103044 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 04:26:51.103225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Wed Jul 27 04:26:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 04:26:51.497611 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f7fb22c1-e743-41ae-8b66-aea00cd8a964 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:51.498240 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f7fb22c1-e743-41ae-8b66-aea00cd8a964 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:51.505891 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f7fb22c1-e743-41ae-8b66-aea00cd8a964 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:51.506378 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f7fb22c1-e743-41ae-8b66-aea00cd8a964 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:51.507513 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f7fb22c1-e743-41ae-8b66-aea00cd8a964 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:51.508296 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f7fb22c1-e743-41ae-8b66-aea00cd8a964 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:51.532314 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:51.654365 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f7fb22c1-e743-41ae-8b66-aea00cd8a964 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:51.662292 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f7fb22c1-e743-41ae-8b66-aea00cd8a964 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1507 microversion: 2.1 time: 0.169620 Jul 27 04:26:51.662784 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 241/491] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:51 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:52.048917 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-28b1021a-3004-4c54-b684-3604af7200fa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:52.049458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-28b1021a-3004-4c54-b684-3604af7200fa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:52.056736 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28b1021a-3004-4c54-b684-3604af7200fa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:52.057189 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28b1021a-3004-4c54-b684-3604af7200fa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:52.058216 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28b1021a-3004-4c54-b684-3604af7200fa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:52.058674 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28b1021a-3004-4c54-b684-3604af7200fa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:52.125370 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-28b1021a-3004-4c54-b684-3604af7200fa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:52.133527 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-28b1021a-3004-4c54-b684-3604af7200fa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:52.135070 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-28b1021a-3004-4c54-b684-3604af7200fa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:52.136214 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-28b1021a-3004-4c54-b684-3604af7200fa tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1284 microversion: 2.20 time: 0.091412 Jul 27 04:26:52.136912 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 251/492] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:52 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:26:52.686007 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9d9d88b7-e627-4e52-94fd-7424bb1cbdd1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:52.686884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9d9d88b7-e627-4e52-94fd-7424bb1cbdd1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:52.695049 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9d9d88b7-e627-4e52-94fd-7424bb1cbdd1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:52.695628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9d9d88b7-e627-4e52-94fd-7424bb1cbdd1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:52.696824 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9d9d88b7-e627-4e52-94fd-7424bb1cbdd1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:52.707609 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9d9d88b7-e627-4e52-94fd-7424bb1cbdd1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:52.940944 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9d9d88b7-e627-4e52-94fd-7424bb1cbdd1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:52.950291 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9d9d88b7-e627-4e52-94fd-7424bb1cbdd1 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 200 len: 1507 microversion: 2.1 time: 0.269674 Jul 27 04:26:52.951073 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 242/493] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:52 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:53.109720 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-96311ec3-1482-4491-885a-e1b870aab51a req-8210867a-dddd-456c-8df0-cd1597129b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259425f9-0ddb-4181-8639-9b3446d21d80", "name": "network-vif-deleted", "tag": "7e7ba03c-2d08-4012-8a46-6bae711cc6e3"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:26:53.119767 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-96311ec3-1482-4491-885a-e1b870aab51a req-8210867a-dddd-456c-8df0-cd1597129b88 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:53.120762 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-96311ec3-1482-4491-885a-e1b870aab51a req-8210867a-dddd-456c-8df0-cd1597129b88 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:53.132707 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-96311ec3-1482-4491-885a-e1b870aab51a req-8210867a-dddd-456c-8df0-cd1597129b88 service nova] Creating event network-vif-deleted:7e7ba03c-2d08-4012-8a46-6bae711cc6e3 for instance 259425f9-0ddb-4181-8639-9b3446d21d80 on hv-cinder-85098 Jul 27 04:26:53.141359 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-96311ec3-1482-4491-885a-e1b870aab51a req-8210867a-dddd-456c-8df0-cd1597129b88 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034367 Jul 27 04:26:53.143785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 252/494] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:26:53.160594 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-20299e93-bcc7-4559-a8f0-b799b4078f8b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:53.161388 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-20299e93-bcc7-4559-a8f0-b799b4078f8b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:53.179327 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-20299e93-bcc7-4559-a8f0-b799b4078f8b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:53.179876 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-20299e93-bcc7-4559-a8f0-b799b4078f8b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:53.180907 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-20299e93-bcc7-4559-a8f0-b799b4078f8b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:53.181350 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-20299e93-bcc7-4559-a8f0-b799b4078f8b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:53.254118 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-20299e93-bcc7-4559-a8f0-b799b4078f8b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:53.263848 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-20299e93-bcc7-4559-a8f0-b799b4078f8b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:53.265469 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-20299e93-bcc7-4559-a8f0-b799b4078f8b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:53.266684 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-20299e93-bcc7-4559-a8f0-b799b4078f8b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1338 microversion: 2.20 time: 0.110999 Jul 27 04:26:53.267331 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 243/495] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:53 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:26:53.972229 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-21df5c7f-e7a3-4f22-b191-2ac5548c2da3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:53.972920 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-21df5c7f-e7a3-4f22-b191-2ac5548c2da3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: 259425f9-0ddb-4181-8639-9b3446d21d80] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:53.983701 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-21df5c7f-e7a3-4f22-b191-2ac5548c2da3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:53.984149 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-21df5c7f-e7a3-4f22-b191-2ac5548c2da3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:53.984934 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-21df5c7f-e7a3-4f22-b191-2ac5548c2da3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:53.985450 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-21df5c7f-e7a3-4f22-b191-2ac5548c2da3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:53.999545 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-21df5c7f-e7a3-4f22-b191-2ac5548c2da3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] HTTP exception thrown: Instance 259425f9-0ddb-4181-8639-9b3446d21d80 could not be found. Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-21df5c7f-e7a3-4f22-b191-2ac5548c2da3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Request method failure captured: Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 HTTP/1.1 Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L1Z-GzUdIE10GBth8M9cTTXAKFLlAQub-RLT6WXeUQ2VTjpVcQi9ERrlBs4sOixL-py8Kq_jHt_mJTkFcFxZ2U68zJZmnqGbGiZAMMZ4GJmWWXTF0LUNVT9PhKk7EpB-gN290q8fAEZkyrjCK6yf2Eia0XZsajg3TgawFCUPD4ekpI Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 5bb7f3d2bc1e4651b7f1e0ac6debd89a Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:26:54.001344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:26:54.002676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:26:54.002676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:26:54.002676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 5bb7f3d2bc1e4651b7f1e0ac6debd89a Jul 27 04:26:54.002676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:26:54.002676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-ServerRescueNegativeTestJSON-708246425-project Jul 27 04:26:54.002676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:26:54.002676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:26:54.002676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 5a69202d87094049b12765d64c17e515 Jul 27 04:26:54.002676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-708246425-project Jul 27 04:26:54.002676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:26:54.002676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 259425f9-0ddb-4181-8639-9b3446d21d80 could not be found. Jul 27 04:26:54.002676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '259425f9-0ddb-4181-8639-9b3446d21d80'} Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 259425f9-0ddb-4181-8639-9b3446d21d80 could not be found. Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:26:54.003428 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 259425f9-0ddb-4181-8639-9b3446d21d80 could not be found. Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 259425f9-0ddb-4181-8639-9b3446d21d80 could not be found. Jul 27 04:26:54.004568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:54.005666 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-21df5c7f-e7a3-4f22-b191-2ac5548c2da3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Returning 404 to user: Instance 259425f9-0ddb-4181-8639-9b3446d21d80 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:26:54.005666 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-21df5c7f-e7a3-4f22-b191-2ac5548c2da3 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80" status: 404 len: 111 microversion: 2.1 time: 0.034853 Jul 27 04:26:54.005666 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 253/496] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:53 2022] GET /compute/v2.1/servers/259425f9-0ddb-4181-8639-9b3446d21d80 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:26:54.015800 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6bafdcb4-cbac-43fb-8ceb-6ffac7d8ca2c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:54.016354 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6bafdcb4-cbac-43fb-8ceb-6ffac7d8ca2c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:54.022911 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6bafdcb4-cbac-43fb-8ceb-6ffac7d8ca2c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:54.023361 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6bafdcb4-cbac-43fb-8ceb-6ffac7d8ca2c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:54.024135 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6bafdcb4-cbac-43fb-8ceb-6ffac7d8ca2c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:54.024567 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6bafdcb4-cbac-43fb-8ceb-6ffac7d8ca2c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:54.056564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6bafdcb4-cbac-43fb-8ceb-6ffac7d8ca2c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Going to try to terminate instance {{(pid=117739) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:26:54.136548 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-c5e2f820-b91d-4327-ae5a-1fef932f4d6f req-a7eecd27-53dc-4b59-b986-d4a410067237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea65d581-c4a6-4764-93c8-5ca7b0fe08fa", "tag": "30ff67e2-9db2-4be1-97bd-8066d0658180"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:26:54.147439 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-c5e2f820-b91d-4327-ae5a-1fef932f4d6f req-a7eecd27-53dc-4b59-b986-d4a410067237 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:54.147875 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-c5e2f820-b91d-4327-ae5a-1fef932f4d6f req-a7eecd27-53dc-4b59-b986-d4a410067237 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:54.150890 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6bafdcb4-cbac-43fb-8ceb-6ffac7d8ca2c tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 204 len: 0 microversion: 2.1 time: 0.139936 Jul 27 04:26:54.152647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:54.157319 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 244/497] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:26:54 2022] DELETE /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:26:54.167274 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e4c36ea6-3d1f-4b07-92c7-25906b9a9dfc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:54.167274 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e4c36ea6-3d1f-4b07-92c7-25906b9a9dfc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:54.174909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4c36ea6-3d1f-4b07-92c7-25906b9a9dfc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:54.175643 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4c36ea6-3d1f-4b07-92c7-25906b9a9dfc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:54.175813 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-c5e2f820-b91d-4327-ae5a-1fef932f4d6f req-a7eecd27-53dc-4b59-b986-d4a410067237 service nova] Creating event network-changed:30ff67e2-9db2-4be1-97bd-8066d0658180 for instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa on hv-cinder-85098 Jul 27 04:26:54.176436 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4c36ea6-3d1f-4b07-92c7-25906b9a9dfc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:54.176879 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4c36ea6-3d1f-4b07-92c7-25906b9a9dfc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:54.186507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-c5e2f820-b91d-4327-ae5a-1fef932f4d6f req-a7eecd27-53dc-4b59-b986-d4a410067237 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054030 Jul 27 04:26:54.187410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 254/498] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:26:54.290713 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-aef8e9e8-1df7-435e-a4a9-d061f2caf744 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:54.291725 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-aef8e9e8-1df7-435e-a4a9-d061f2caf744 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:54.299169 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-aef8e9e8-1df7-435e-a4a9-d061f2caf744 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:54.299876 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-aef8e9e8-1df7-435e-a4a9-d061f2caf744 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:54.300934 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-aef8e9e8-1df7-435e-a4a9-d061f2caf744 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:54.302020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-aef8e9e8-1df7-435e-a4a9-d061f2caf744 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:54.331842 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e4c36ea6-3d1f-4b07-92c7-25906b9a9dfc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:54.339441 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e4c36ea6-3d1f-4b07-92c7-25906b9a9dfc tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.180199 Jul 27 04:26:54.340024 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 245/499] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:54 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:54.438435 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-aef8e9e8-1df7-435e-a4a9-d061f2caf744 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:54.446562 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-aef8e9e8-1df7-435e-a4a9-d061f2caf744 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:54.448683 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-aef8e9e8-1df7-435e-a4a9-d061f2caf744 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:54.449916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-aef8e9e8-1df7-435e-a4a9-d061f2caf744 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1405 microversion: 2.20 time: 0.163427 Jul 27 04:26:54.450508 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 255/500] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:54 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:26:55.360040 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c107ced3-6079-47b2-b718-b719acf5bba2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:55.360762 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c107ced3-6079-47b2-b718-b719acf5bba2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:55.366821 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c107ced3-6079-47b2-b718-b719acf5bba2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:55.367262 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c107ced3-6079-47b2-b718-b719acf5bba2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:55.368020 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c107ced3-6079-47b2-b718-b719acf5bba2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:55.368449 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c107ced3-6079-47b2-b718-b719acf5bba2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:55.472524 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ecb6d595-3897-450b-9ec9-b9018eca3ebe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:55.473157 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ecb6d595-3897-450b-9ec9-b9018eca3ebe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:55.479588 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ecb6d595-3897-450b-9ec9-b9018eca3ebe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:55.480029 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ecb6d595-3897-450b-9ec9-b9018eca3ebe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:55.480789 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ecb6d595-3897-450b-9ec9-b9018eca3ebe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:55.481219 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ecb6d595-3897-450b-9ec9-b9018eca3ebe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:55.498408 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c107ced3-6079-47b2-b718-b719acf5bba2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:55.505922 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c107ced3-6079-47b2-b718-b719acf5bba2 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.149614 Jul 27 04:26:55.510373 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 246/501] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:55 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:55.611128 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ecb6d595-3897-450b-9ec9-b9018eca3ebe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:55.618971 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ecb6d595-3897-450b-9ec9-b9018eca3ebe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:55.620621 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ecb6d595-3897-450b-9ec9-b9018eca3ebe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:55.621706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ecb6d595-3897-450b-9ec9-b9018eca3ebe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1405 microversion: 2.20 time: 0.153080 Jul 27 04:26:55.622305 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 256/502] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:55 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:26:56.529354 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5c732444-8e5f-4df5-95a5-e70f3d02007f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:56.529963 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-5c732444-8e5f-4df5-95a5-e70f3d02007f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:56.536402 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5c732444-8e5f-4df5-95a5-e70f3d02007f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:56.536846 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5c732444-8e5f-4df5-95a5-e70f3d02007f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:56.537605 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5c732444-8e5f-4df5-95a5-e70f3d02007f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:56.538069 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5c732444-8e5f-4df5-95a5-e70f3d02007f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:56.644633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a89fa031-02b2-4b4a-9ada-29addbb98c26 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:56.645251 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a89fa031-02b2-4b4a-9ada-29addbb98c26 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:56.652152 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a89fa031-02b2-4b4a-9ada-29addbb98c26 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:56.652611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a89fa031-02b2-4b4a-9ada-29addbb98c26 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:56.653378 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a89fa031-02b2-4b4a-9ada-29addbb98c26 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:56.653812 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a89fa031-02b2-4b4a-9ada-29addbb98c26 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:56.671292 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-5c732444-8e5f-4df5-95a5-e70f3d02007f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:56.678756 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-5c732444-8e5f-4df5-95a5-e70f3d02007f tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1522 microversion: 2.1 time: 0.154467 Jul 27 04:26:56.679330 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 247/503] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:56 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:26:56.783631 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a89fa031-02b2-4b4a-9ada-29addbb98c26 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:56.791391 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a89fa031-02b2-4b4a-9ada-29addbb98c26 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:56.793658 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a89fa031-02b2-4b4a-9ada-29addbb98c26 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:56.794778 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a89fa031-02b2-4b4a-9ada-29addbb98c26 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1405 microversion: 2.20 time: 0.154015 Jul 27 04:26:56.795332 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 257/504] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:56 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:26:57.673230 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-1f73b216-a9fe-48aa-86b5-f2ecba137d49 req-2c938e0a-65e2-4d7f-9ad9-591bc20eee6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c", "name": "network-vif-deleted", "tag": "a40f4c5b-77ca-4a0a-a4d4-f5f9a5b1014f"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:26:57.684405 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-1f73b216-a9fe-48aa-86b5-f2ecba137d49 req-2c938e0a-65e2-4d7f-9ad9-591bc20eee6d service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:57.684868 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-1f73b216-a9fe-48aa-86b5-f2ecba137d49 req-2c938e0a-65e2-4d7f-9ad9-591bc20eee6d service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:57.695494 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-1f73b216-a9fe-48aa-86b5-f2ecba137d49 req-2c938e0a-65e2-4d7f-9ad9-591bc20eee6d service nova] Creating event network-vif-deleted:a40f4c5b-77ca-4a0a-a4d4-f5f9a5b1014f for instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c on hv-cinder-85098 Jul 27 04:26:57.700342 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d0daf211-ad65-4af2-bb39-f1a6e7f8f9bf tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:57.701016 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d0daf211-ad65-4af2-bb39-f1a6e7f8f9bf tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:57.701141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-1f73b216-a9fe-48aa-86b5-f2ecba137d49 req-2c938e0a-65e2-4d7f-9ad9-591bc20eee6d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031614 Jul 27 04:26:57.701659 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 248/505] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:26:57.707397 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d0daf211-ad65-4af2-bb39-f1a6e7f8f9bf tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:57.707845 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d0daf211-ad65-4af2-bb39-f1a6e7f8f9bf tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:57.708614 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d0daf211-ad65-4af2-bb39-f1a6e7f8f9bf tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:57.709052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d0daf211-ad65-4af2-bb39-f1a6e7f8f9bf tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:57.770491 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d0daf211-ad65-4af2-bb39-f1a6e7f8f9bf tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a69202d87094049b12765d64c17e515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb7f3d2bc1e4651b7f1e0ac6debd89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:57.777901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d0daf211-ad65-4af2-bb39-f1a6e7f8f9bf tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 200 len: 1480 microversion: 2.1 time: 0.082546 Jul 27 04:26:57.778505 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 258/506] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:57 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 1480 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:26:57.817685 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ad162349-f7b0-468c-bb99-df8d66e1f322 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:57.818404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ad162349-f7b0-468c-bb99-df8d66e1f322 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:57.825447 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ad162349-f7b0-468c-bb99-df8d66e1f322 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:57.825889 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ad162349-f7b0-468c-bb99-df8d66e1f322 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:57.826675 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ad162349-f7b0-468c-bb99-df8d66e1f322 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:57.827113 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ad162349-f7b0-468c-bb99-df8d66e1f322 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:57.961755 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ad162349-f7b0-468c-bb99-df8d66e1f322 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:57.970495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ad162349-f7b0-468c-bb99-df8d66e1f322 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:57.972007 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ad162349-f7b0-468c-bb99-df8d66e1f322 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:57.973120 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ad162349-f7b0-468c-bb99-df8d66e1f322 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1405 microversion: 2.20 time: 0.159631 Jul 27 04:26:57.973713 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 249/507] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:57 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:26:58.799063 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8fedafa0-cdf6-4102-87a7-f6b116970c27 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:58.799678 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-8fedafa0-cdf6-4102-87a7-f6b116970c27 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] [instance: b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:58.806198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8fedafa0-cdf6-4102-87a7-f6b116970c27 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:58.806655 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8fedafa0-cdf6-4102-87a7-f6b116970c27 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:58.807557 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8fedafa0-cdf6-4102-87a7-f6b116970c27 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:58.808147 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8fedafa0-cdf6-4102-87a7-f6b116970c27 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:58.821731 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-8fedafa0-cdf6-4102-87a7-f6b116970c27 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] HTTP exception thrown: Instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c could not be found. Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8fedafa0-cdf6-4102-87a7-f6b116970c27 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Request method failure captured: Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c HTTP/1.1 Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L1Z-GzUdIE10GBth8M9cTTXAKFLlAQub-RLT6WXeUQ2VTjpVcQi9ERrlBs4sOixL-py8Kq_jHt_mJTkFcFxZ2U68zJZmnqGbGiZAMMZ4GJmWWXTF0LUNVT9PhKk7EpB-gN290q8fAEZkyrjCK6yf2Eia0XZsajg3TgawFCUPD4ekpI Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 5bb7f3d2bc1e4651b7f1e0ac6debd89a Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:26:58.823901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:26:58.825469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5bb7f3d2bc1e4651b7f1e0ac6debd89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:26:58.825469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:26:58.825469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 5bb7f3d2bc1e4651b7f1e0ac6debd89a Jul 27 04:26:58.825469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-708246425 Jul 27 04:26:58.825469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-ServerRescueNegativeTestJSON-708246425-project Jul 27 04:26:58.825469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:26:58.825469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:26:58.825469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 5a69202d87094049b12765d64c17e515 Jul 27 04:26:58.825469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-708246425-project Jul 27 04:26:58.825469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:26:58.825469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c could not be found. Jul 27 04:26:58.825469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': 'b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c'} Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c could not be found. Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:26:58.826481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c could not be found. Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c could not be found. Jul 27 04:26:58.827915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:26:58.829289 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8fedafa0-cdf6-4102-87a7-f6b116970c27 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] Returning 404 to user: Instance b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:26:58.829289 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8fedafa0-cdf6-4102-87a7-f6b116970c27 tempest-ServerRescueNegativeTestJSON-708246425 tempest-ServerRescueNegativeTestJSON-708246425-project] 10.222.0.46 "GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c" status: 404 len: 111 microversion: 2.1 time: 0.030081 Jul 27 04:26:58.829289 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 259/508] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:26:58 2022] GET /compute/v2.1/servers/b7ee7e12-b7b2-4fb8-8ee6-7fc10b35217c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:26:58.996619 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-78d3a38d-0eb6-49f6-9866-33cc9eb08f8a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:26:58.997885 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-78d3a38d-0eb6-49f6-9866-33cc9eb08f8a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:26:59.004772 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-78d3a38d-0eb6-49f6-9866-33cc9eb08f8a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:59.005218 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-78d3a38d-0eb6-49f6-9866-33cc9eb08f8a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:59.006059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-78d3a38d-0eb6-49f6-9866-33cc9eb08f8a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:26:59.006450 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-78d3a38d-0eb6-49f6-9866-33cc9eb08f8a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:26:59.140357 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-78d3a38d-0eb6-49f6-9866-33cc9eb08f8a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:59.149333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-78d3a38d-0eb6-49f6-9866-33cc9eb08f8a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:59.150877 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-78d3a38d-0eb6-49f6-9866-33cc9eb08f8a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:26:59.152780 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-78d3a38d-0eb6-49f6-9866-33cc9eb08f8a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1405 microversion: 2.20 time: 0.160287 Jul 27 04:26:59.153345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 250/509] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:26:58 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:27:00.175312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3a7a8f04-b745-4b68-a821-8d36df48dfdd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:00.176103 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3a7a8f04-b745-4b68-a821-8d36df48dfdd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:00.184035 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3a7a8f04-b745-4b68-a821-8d36df48dfdd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:00.184486 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3a7a8f04-b745-4b68-a821-8d36df48dfdd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:00.185291 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3a7a8f04-b745-4b68-a821-8d36df48dfdd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:00.185730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3a7a8f04-b745-4b68-a821-8d36df48dfdd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:00.411909 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3a7a8f04-b745-4b68-a821-8d36df48dfdd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:00.420577 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3a7a8f04-b745-4b68-a821-8d36df48dfdd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:00.422117 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3a7a8f04-b745-4b68-a821-8d36df48dfdd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:00.423226 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3a7a8f04-b745-4b68-a821-8d36df48dfdd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1405 microversion: 2.20 time: 0.251895 Jul 27 04:27:00.423785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 260/510] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:00 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:01.445649 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-28079121-1541-4921-bd31-645058c8957e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:01.446540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-28079121-1541-4921-bd31-645058c8957e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:01.449580 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:01.450209 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=6 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:01.461799 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-28079121-1541-4921-bd31-645058c8957e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:01.462280 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-28079121-1541-4921-bd31-645058c8957e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:01.463062 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-28079121-1541-4921-bd31-645058c8957e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:01.464109 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-28079121-1541-4921-bd31-645058c8957e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:01.623196 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-28079121-1541-4921-bd31-645058c8957e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:01.632874 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-28079121-1541-4921-bd31-645058c8957e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:01.634827 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-28079121-1541-4921-bd31-645058c8957e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:01.636572 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-28079121-1541-4921-bd31-645058c8957e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1405 microversion: 2.20 time: 0.194890 Jul 27 04:27:01.647290 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 251/511] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:01 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:02.659234 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-79e7ef15-b0e1-4c19-a596-158e7be8d0c6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:02.659888 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-79e7ef15-b0e1-4c19-a596-158e7be8d0c6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:02.662035 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=6 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:02.668456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-79e7ef15-b0e1-4c19-a596-158e7be8d0c6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:02.668906 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-79e7ef15-b0e1-4c19-a596-158e7be8d0c6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:02.669697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-79e7ef15-b0e1-4c19-a596-158e7be8d0c6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:02.670167 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-79e7ef15-b0e1-4c19-a596-158e7be8d0c6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:02.820442 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-79e7ef15-b0e1-4c19-a596-158e7be8d0c6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:02.829482 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-79e7ef15-b0e1-4c19-a596-158e7be8d0c6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:02.831014 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-79e7ef15-b0e1-4c19-a596-158e7be8d0c6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:02.839203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-79e7ef15-b0e1-4c19-a596-158e7be8d0c6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1405 microversion: 2.20 time: 0.183928 Jul 27 04:27:02.844345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 261/512] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:02 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:03.196642 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-0a9130ee-824f-44e6-a3c0-a4fafdb1a6cb req-da18935f-4465-4ed9-9e70-c44000b8a3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea65d581-c4a6-4764-93c8-5ca7b0fe08fa", "name": "network-vif-plugged", "status": "completed", "tag": "30ff67e2-9db2-4be1-97bd-8066d0658180"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:03.207051 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-0a9130ee-824f-44e6-a3c0-a4fafdb1a6cb req-da18935f-4465-4ed9-9e70-c44000b8a3f4 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:03.207589 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-0a9130ee-824f-44e6-a3c0-a4fafdb1a6cb req-da18935f-4465-4ed9-9e70-c44000b8a3f4 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:03.219711 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-0a9130ee-824f-44e6-a3c0-a4fafdb1a6cb req-da18935f-4465-4ed9-9e70-c44000b8a3f4 service nova] Creating event network-vif-plugged:30ff67e2-9db2-4be1-97bd-8066d0658180 for instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa on hv-cinder-85098 Jul 27 04:27:03.225067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-0a9130ee-824f-44e6-a3c0-a4fafdb1a6cb req-da18935f-4465-4ed9-9e70-c44000b8a3f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032271 Jul 27 04:27:03.225663 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 252/513] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:27:03.868070 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-63be4dae-2704-4327-8deb-630d3101352b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:03.868939 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-63be4dae-2704-4327-8deb-630d3101352b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:03.876325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-63be4dae-2704-4327-8deb-630d3101352b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:03.876830 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-63be4dae-2704-4327-8deb-630d3101352b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:03.877813 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-63be4dae-2704-4327-8deb-630d3101352b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:03.878291 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-63be4dae-2704-4327-8deb-630d3101352b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:04.090416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-63be4dae-2704-4327-8deb-630d3101352b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:04.098390 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-63be4dae-2704-4327-8deb-630d3101352b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:04.099888 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-63be4dae-2704-4327-8deb-630d3101352b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:04.101029 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-63be4dae-2704-4327-8deb-630d3101352b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1405 microversion: 2.20 time: 0.237147 Jul 27 04:27:04.101578 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 262/514] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:03 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1405 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:05.127909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2defac40-080f-4de1-a276-b1c768172a97 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:05.128741 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2defac40-080f-4de1-a276-b1c768172a97 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:05.138639 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2defac40-080f-4de1-a276-b1c768172a97 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:05.139211 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2defac40-080f-4de1-a276-b1c768172a97 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:05.140063 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2defac40-080f-4de1-a276-b1c768172a97 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:05.140506 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2defac40-080f-4de1-a276-b1c768172a97 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:05.629527 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2defac40-080f-4de1-a276-b1c768172a97 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:05.638966 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2defac40-080f-4de1-a276-b1c768172a97 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:05.640521 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2defac40-080f-4de1-a276-b1c768172a97 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:05.641693 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2defac40-080f-4de1-a276-b1c768172a97 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1597 microversion: 2.20 time: 0.520568 Jul 27 04:27:05.642786 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 253/515] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:05 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1597 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:05.664568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c4222e72-30db-4ba0-92c5-a9fd3b77e52d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:05.665141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c4222e72-30db-4ba0-92c5-a9fd3b77e52d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:05.672763 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c4222e72-30db-4ba0-92c5-a9fd3b77e52d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:05.673394 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c4222e72-30db-4ba0-92c5-a9fd3b77e52d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:05.674369 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c4222e72-30db-4ba0-92c5-a9fd3b77e52d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:05.674803 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c4222e72-30db-4ba0-92c5-a9fd3b77e52d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:05.763945 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c4222e72-30db-4ba0-92c5-a9fd3b77e52d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103288 Jul 27 04:27:05.769720 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 263/516] 10.222.0.46 () {60 vars in 1316 bytes} [Wed Jul 27 04:27:05 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 04:27:07.314134 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-235ef22f-e04c-4169-abe2-88d01d118e72 req-07f90852-6905-4b3c-8555-f900f7c11439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea65d581-c4a6-4764-93c8-5ca7b0fe08fa", "tag": "30ff67e2-9db2-4be1-97bd-8066d0658180"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:07.326468 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-235ef22f-e04c-4169-abe2-88d01d118e72 req-07f90852-6905-4b3c-8555-f900f7c11439 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:07.327127 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-235ef22f-e04c-4169-abe2-88d01d118e72 req-07f90852-6905-4b3c-8555-f900f7c11439 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:07.351567 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-235ef22f-e04c-4169-abe2-88d01d118e72 req-07f90852-6905-4b3c-8555-f900f7c11439 service nova] Creating event network-changed:30ff67e2-9db2-4be1-97bd-8066d0658180 for instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa on hv-cinder-85098 Jul 27 04:27:07.361879 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-235ef22f-e04c-4169-abe2-88d01d118e72 req-07f90852-6905-4b3c-8555-f900f7c11439 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.269696 Jul 27 04:27:07.362961 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 254/517] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:27:08.436324 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-190e0a82-b6b0-4c97-b9b8-e9cf7709babd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Action: 'create', calling method: .version_select at 0x7f21d5b79f70>, body: {"keypair": {"name": "tempest-keypair-942173467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtWY7GFH2Fiyn/xj2Q4jjN2EfOTXy/ubngwnNdlmcE0AjPM7YZJx+LDjV0CyA23bevtNSGiBdt1ITRtIqm3v7HW9kIkYsJBFvCDm2wcBRQ4Ir7xykUee7oe4i9WNb2goQ=="}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:08.444305 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:08.456190 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-190e0a82-b6b0-4c97-b9b8-e9cf7709babd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for project aa51c6088dfa44df848e339d61bac664. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:27:08.462670 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-190e0a82-b6b0-4c97-b9b8-e9cf7709babd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for user 8cbc27f4433e4c48a75b216540a9022f and project aa51c6088dfa44df848e339d61bac664. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:27:08.488265 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-190e0a82-b6b0-4c97-b9b8-e9cf7709babd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117247 Jul 27 04:27:08.496397 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 264/518] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Jul 27 04:27:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:27:10.045490 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1111780396", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7941c677-84e1-4370-9083-08b3d22ae50b"}], "security_groups": [{"name": "tempest-securitygroup--763527113"}], "key_name": "tempest-keypair-942173467", "user_data": "}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:10.053548 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:10.151258 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] validate_networks() for [('7941c677-84e1-4370-9083-08b3d22ae50b', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:27:10.522642 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:27:10.523062 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:27:10.523543 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:27:10.523949 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:27:10.524389 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:27:10.533700 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:10.534177 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:10.534976 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:10.535407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:10.553917 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for project aa51c6088dfa44df848e339d61bac664. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:27:10.558672 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for user 8cbc27f4433e4c48a75b216540a9022f and project aa51c6088dfa44df848e339d61bac664. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:27:10.570088 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:27:10.573360 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:27:10.619885 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-7d31c314-7f8e-48a1-8665-9584a3c3ea84 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.579680 Jul 27 04:27:10.626319 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 255/519] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:27:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:27:10.632361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ecb4bc95-c092-498e-b1f8-27964b2acb85 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:10.633772 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ecb4bc95-c092-498e-b1f8-27964b2acb85 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:10.691080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ecb4bc95-c092-498e-b1f8-27964b2acb85 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:10.699596 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ecb4bc95-c092-498e-b1f8-27964b2acb85 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1241 microversion: 2.1 time: 0.071559 Jul 27 04:27:10.700240 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 265/520] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:10 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:11.722610 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-23d5567f-f7a7-40c2-8cdd-2d84781b5baa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:11.723217 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-23d5567f-f7a7-40c2-8cdd-2d84781b5baa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:11.733066 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-23d5567f-f7a7-40c2-8cdd-2d84781b5baa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:11.733507 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-23d5567f-f7a7-40c2-8cdd-2d84781b5baa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:11.734310 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-23d5567f-f7a7-40c2-8cdd-2d84781b5baa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:11.734741 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-23d5567f-f7a7-40c2-8cdd-2d84781b5baa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:11.829910 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-23d5567f-f7a7-40c2-8cdd-2d84781b5baa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:11.837965 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-23d5567f-f7a7-40c2-8cdd-2d84781b5baa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1301 microversion: 2.1 time: 0.119173 Jul 27 04:27:11.838596 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 256/521] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:11 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1301 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:12.859949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-41452570-9d32-4664-8c3d-32be79c06850 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:12.861181 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-41452570-9d32-4664-8c3d-32be79c06850 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:12.869214 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-41452570-9d32-4664-8c3d-32be79c06850 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:12.869877 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-41452570-9d32-4664-8c3d-32be79c06850 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:12.870945 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-41452570-9d32-4664-8c3d-32be79c06850 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:12.871697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-41452570-9d32-4664-8c3d-32be79c06850 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:13.014459 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-41452570-9d32-4664-8c3d-32be79c06850 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:13.023469 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-41452570-9d32-4664-8c3d-32be79c06850 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1366 microversion: 2.1 time: 0.167238 Jul 27 04:27:13.024048 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 266/522] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:12 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:13.157117 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-15256dfc-35a2-4fdf-a04a-155d9cc8cd65 req-092c1a95-d0b2-48de-a1dc-ed231c9f56ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df1d9b6-b48f-46d2-876e-dd6d14f70285", "tag": "86c730dd-d6d3-4a99-8960-7e754ffd99e8"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:13.173472 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-15256dfc-35a2-4fdf-a04a-155d9cc8cd65 req-092c1a95-d0b2-48de-a1dc-ed231c9f56ea service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:13.174139 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-15256dfc-35a2-4fdf-a04a-155d9cc8cd65 req-092c1a95-d0b2-48de-a1dc-ed231c9f56ea service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:13.187346 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-15256dfc-35a2-4fdf-a04a-155d9cc8cd65 req-092c1a95-d0b2-48de-a1dc-ed231c9f56ea service nova] Creating event network-changed:86c730dd-d6d3-4a99-8960-7e754ffd99e8 for instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 on hv-cinder-85098 Jul 27 04:27:13.192557 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-15256dfc-35a2-4fdf-a04a-155d9cc8cd65 req-092c1a95-d0b2-48de-a1dc-ed231c9f56ea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039438 Jul 27 04:27:13.193165 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 257/523] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:27:14.045310 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8d2ce8a0-2107-4920-9d40-0ab47bb20e96 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:14.045931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-8d2ce8a0-2107-4920-9d40-0ab47bb20e96 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:14.052611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8d2ce8a0-2107-4920-9d40-0ab47bb20e96 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:14.053059 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8d2ce8a0-2107-4920-9d40-0ab47bb20e96 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:14.053819 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8d2ce8a0-2107-4920-9d40-0ab47bb20e96 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:14.054297 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8d2ce8a0-2107-4920-9d40-0ab47bb20e96 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:14.181815 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-8d2ce8a0-2107-4920-9d40-0ab47bb20e96 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:14.189354 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8d2ce8a0-2107-4920-9d40-0ab47bb20e96 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1366 microversion: 2.1 time: 0.148596 Jul 27 04:27:14.189915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 267/524] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:14 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:15.211031 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-dfe5c376-1ea9-4014-bd7a-cf8159f7e527 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:15.211723 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-dfe5c376-1ea9-4014-bd7a-cf8159f7e527 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:15.217940 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-dfe5c376-1ea9-4014-bd7a-cf8159f7e527 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:15.218406 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-dfe5c376-1ea9-4014-bd7a-cf8159f7e527 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:15.219158 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-dfe5c376-1ea9-4014-bd7a-cf8159f7e527 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:15.219593 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-dfe5c376-1ea9-4014-bd7a-cf8159f7e527 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:15.346729 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-dfe5c376-1ea9-4014-bd7a-cf8159f7e527 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:15.354516 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-dfe5c376-1ea9-4014-bd7a-cf8159f7e527 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1366 microversion: 2.1 time: 0.147573 Jul 27 04:27:15.355080 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 258/525] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:15 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:16.375674 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0f29b650-9fa9-4947-8d03-9acfad4864c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:16.376279 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0f29b650-9fa9-4947-8d03-9acfad4864c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:16.382761 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0f29b650-9fa9-4947-8d03-9acfad4864c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:16.383203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0f29b650-9fa9-4947-8d03-9acfad4864c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:16.383957 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0f29b650-9fa9-4947-8d03-9acfad4864c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:16.384386 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0f29b650-9fa9-4947-8d03-9acfad4864c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:16.519245 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0f29b650-9fa9-4947-8d03-9acfad4864c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:16.527262 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0f29b650-9fa9-4947-8d03-9acfad4864c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1366 microversion: 2.1 time: 0.155452 Jul 27 04:27:16.527833 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 268/526] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:16 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:17.547334 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7ca294cc-218b-4a91-95bc-d749f1a066c7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:17.548128 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-7ca294cc-218b-4a91-95bc-d749f1a066c7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:17.554582 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7ca294cc-218b-4a91-95bc-d749f1a066c7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:17.555026 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7ca294cc-218b-4a91-95bc-d749f1a066c7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:17.555783 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7ca294cc-218b-4a91-95bc-d749f1a066c7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:17.556212 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7ca294cc-218b-4a91-95bc-d749f1a066c7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:17.679954 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-45f7a1aa-1599-4091-8d04-07d4d6ce1403 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:17.680538 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-45f7a1aa-1599-4091-8d04-07d4d6ce1403 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:17.687967 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-7ca294cc-218b-4a91-95bc-d749f1a066c7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:17.688636 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-45f7a1aa-1599-4091-8d04-07d4d6ce1403 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:17.689087 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-45f7a1aa-1599-4091-8d04-07d4d6ce1403 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:17.689860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-45f7a1aa-1599-4091-8d04-07d4d6ce1403 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:17.690324 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-45f7a1aa-1599-4091-8d04-07d4d6ce1403 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:17.691420 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:17.696640 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-7ca294cc-218b-4a91-95bc-d749f1a066c7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1366 microversion: 2.1 time: 0.152897 Jul 27 04:27:17.697207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 259/527] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:17 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:17.716208 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-45f7a1aa-1599-4091-8d04-07d4d6ce1403 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lazy-loading 'flavor' on Instance uuid 5496cce3-6266-4650-84ba-9e01e99cbea6 {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:27:17.786776 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-45f7a1aa-1599-4091-8d04-07d4d6ce1403 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "POST /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6/action" status: 202 len: 0 microversion: 2.1 time: 0.110540 Jul 27 04:27:17.787374 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 269/528] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:27:17 2022] POST /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 04:27:17.795680 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-26c2694b-f237-4af6-9c44-a372dcead630 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:17.796292 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-26c2694b-f237-4af6-9c44-a372dcead630 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:17.803401 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-26c2694b-f237-4af6-9c44-a372dcead630 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:17.803842 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-26c2694b-f237-4af6-9c44-a372dcead630 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:17.804599 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-26c2694b-f237-4af6-9c44-a372dcead630 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:17.805059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-26c2694b-f237-4af6-9c44-a372dcead630 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:17.938075 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-26c2694b-f237-4af6-9c44-a372dcead630 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:17.945414 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-26c2694b-f237-4af6-9c44-a372dcead630 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.153625 Jul 27 04:27:17.945993 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 260/529] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:17 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:18.720092 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4cca5270-4e86-4a15-a5e0-dd58edbd8c6c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:18.720794 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4cca5270-4e86-4a15-a5e0-dd58edbd8c6c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:18.728229 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4cca5270-4e86-4a15-a5e0-dd58edbd8c6c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:18.728688 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4cca5270-4e86-4a15-a5e0-dd58edbd8c6c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:18.729765 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4cca5270-4e86-4a15-a5e0-dd58edbd8c6c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:18.730241 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4cca5270-4e86-4a15-a5e0-dd58edbd8c6c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:18.859537 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4cca5270-4e86-4a15-a5e0-dd58edbd8c6c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:18.866947 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4cca5270-4e86-4a15-a5e0-dd58edbd8c6c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1366 microversion: 2.1 time: 0.151590 Jul 27 04:27:18.867735 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 270/530] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:18 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:18.968111 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-cb35d98a-d449-4f74-85e7-001b9cd5ac8f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:18.968632 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-cb35d98a-d449-4f74-85e7-001b9cd5ac8f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:18.975222 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cb35d98a-d449-4f74-85e7-001b9cd5ac8f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:18.975668 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cb35d98a-d449-4f74-85e7-001b9cd5ac8f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:18.976438 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cb35d98a-d449-4f74-85e7-001b9cd5ac8f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:18.976876 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-cb35d98a-d449-4f74-85e7-001b9cd5ac8f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:19.105627 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-cb35d98a-d449-4f74-85e7-001b9cd5ac8f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:19.113113 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-cb35d98a-d449-4f74-85e7-001b9cd5ac8f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.149847 Jul 27 04:27:19.113803 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 261/531] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:18 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:19.242896 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-d7ce3e1c-1aa0-473b-8286-39153a6b1771 req-56f2da0b-9917-4ae1-b09c-5eb956728339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df1d9b6-b48f-46d2-876e-dd6d14f70285", "name": "network-vif-plugged", "status": "completed", "tag": "86c730dd-d6d3-4a99-8960-7e754ffd99e8"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:19.253380 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-d7ce3e1c-1aa0-473b-8286-39153a6b1771 req-56f2da0b-9917-4ae1-b09c-5eb956728339 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:19.253929 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-d7ce3e1c-1aa0-473b-8286-39153a6b1771 req-56f2da0b-9917-4ae1-b09c-5eb956728339 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:19.267685 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-d7ce3e1c-1aa0-473b-8286-39153a6b1771 req-56f2da0b-9917-4ae1-b09c-5eb956728339 service nova] Creating event network-vif-plugged:86c730dd-d6d3-4a99-8960-7e754ffd99e8 for instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 on hv-cinder-85098 Jul 27 04:27:19.272368 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-d7ce3e1c-1aa0-473b-8286-39153a6b1771 req-56f2da0b-9917-4ae1-b09c-5eb956728339 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033282 Jul 27 04:27:19.272965 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 271/532] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:27:19.888575 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3e293d3c-9452-42ac-bef6-12115acbffbc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:19.889184 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-3e293d3c-9452-42ac-bef6-12115acbffbc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:19.895171 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3e293d3c-9452-42ac-bef6-12115acbffbc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:19.895617 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3e293d3c-9452-42ac-bef6-12115acbffbc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:19.896372 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3e293d3c-9452-42ac-bef6-12115acbffbc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:19.896807 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3e293d3c-9452-42ac-bef6-12115acbffbc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:20.021687 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-3e293d3c-9452-42ac-bef6-12115acbffbc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:20.030150 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-3e293d3c-9452-42ac-bef6-12115acbffbc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1366 microversion: 2.1 time: 0.145697 Jul 27 04:27:20.030707 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 262/533] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:19 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:20.137203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b2307007-7555-4642-a9f9-c8ccd5b615d0 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:20.137895 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b2307007-7555-4642-a9f9-c8ccd5b615d0 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:20.144225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b2307007-7555-4642-a9f9-c8ccd5b615d0 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:20.144612 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b2307007-7555-4642-a9f9-c8ccd5b615d0 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:20.145372 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b2307007-7555-4642-a9f9-c8ccd5b615d0 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:20.145811 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b2307007-7555-4642-a9f9-c8ccd5b615d0 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:20.279510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b2307007-7555-4642-a9f9-c8ccd5b615d0 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:20.286903 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b2307007-7555-4642-a9f9-c8ccd5b615d0 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.155324 Jul 27 04:27:20.287466 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 272/534] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:20 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:21.052381 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3312369f-1576-4e45-aecf-70e8aeb23e79 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:21.052988 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-3312369f-1576-4e45-aecf-70e8aeb23e79 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:21.054858 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:21.055509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=6 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:21.062729 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3312369f-1576-4e45-aecf-70e8aeb23e79 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:21.063197 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3312369f-1576-4e45-aecf-70e8aeb23e79 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:21.063942 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3312369f-1576-4e45-aecf-70e8aeb23e79 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:21.064370 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3312369f-1576-4e45-aecf-70e8aeb23e79 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:21.195313 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-3312369f-1576-4e45-aecf-70e8aeb23e79 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:21.203600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-3312369f-1576-4e45-aecf-70e8aeb23e79 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1556 microversion: 2.1 time: 0.155704 Jul 27 04:27:21.204174 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 263/535] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:21 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:21.223930 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7b78b52e-e563-4807-8cdf-bcaa530de598 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:21.224452 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-7b78b52e-e563-4807-8cdf-bcaa530de598 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:21.226432 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=6 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:21.232791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7b78b52e-e563-4807-8cdf-bcaa530de598 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:21.233247 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7b78b52e-e563-4807-8cdf-bcaa530de598 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:21.234034 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7b78b52e-e563-4807-8cdf-bcaa530de598 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:21.234477 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7b78b52e-e563-4807-8cdf-bcaa530de598 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:21.238056 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:21.309220 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c3c2ad37-1d1b-4e48-8813-748506d421a4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:21.310081 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c3c2ad37-1d1b-4e48-8813-748506d421a4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:21.313057 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-7b78b52e-e563-4807-8cdf-bcaa530de598 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093017 Jul 27 04:27:21.313925 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 273/536] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Jul 27 04:27:21 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:27:21.316334 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c3c2ad37-1d1b-4e48-8813-748506d421a4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:21.316785 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c3c2ad37-1d1b-4e48-8813-748506d421a4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:21.317577 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c3c2ad37-1d1b-4e48-8813-748506d421a4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:21.318061 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c3c2ad37-1d1b-4e48-8813-748506d421a4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:21.455033 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c3c2ad37-1d1b-4e48-8813-748506d421a4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:21.462764 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c3c2ad37-1d1b-4e48-8813-748506d421a4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.158866 Jul 27 04:27:21.463366 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 264/537] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:21 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:27:22.469418 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-a2e88f19-eb93-49a4-94ef-e817c7415a3a req-fb8c42ed-b1a9-49c5-a774-5094795fc1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df1d9b6-b48f-46d2-876e-dd6d14f70285", "tag": "86c730dd-d6d3-4a99-8960-7e754ffd99e8"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:22.481541 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-a2e88f19-eb93-49a4-94ef-e817c7415a3a req-fb8c42ed-b1a9-49c5-a774-5094795fc1cc service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:22.482803 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-a2e88f19-eb93-49a4-94ef-e817c7415a3a req-fb8c42ed-b1a9-49c5-a774-5094795fc1cc service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:22.487026 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-bc67204f-e47b-440f-8ba3-78d853a484f7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:22.488391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-bc67204f-e47b-440f-8ba3-78d853a484f7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:22.495117 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-a2e88f19-eb93-49a4-94ef-e817c7415a3a req-fb8c42ed-b1a9-49c5-a774-5094795fc1cc service nova] Creating event network-changed:86c730dd-d6d3-4a99-8960-7e754ffd99e8 for instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 on hv-cinder-85098 Jul 27 04:27:22.497054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bc67204f-e47b-440f-8ba3-78d853a484f7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:22.497496 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bc67204f-e47b-440f-8ba3-78d853a484f7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:22.498453 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bc67204f-e47b-440f-8ba3-78d853a484f7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:22.498882 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bc67204f-e47b-440f-8ba3-78d853a484f7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:22.500024 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-a2e88f19-eb93-49a4-94ef-e817c7415a3a req-fb8c42ed-b1a9-49c5-a774-5094795fc1cc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034738 Jul 27 04:27:22.501203 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 274/538] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:27:22.557958 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f4161407-02fa-4b11-99ff-55429630e518 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:22.558708 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f4161407-02fa-4b11-99ff-55429630e518 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:22.565513 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f4161407-02fa-4b11-99ff-55429630e518 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:22.566153 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f4161407-02fa-4b11-99ff-55429630e518 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:22.566912 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f4161407-02fa-4b11-99ff-55429630e518 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:22.567421 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f4161407-02fa-4b11-99ff-55429630e518 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:22.594724 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f4161407-02fa-4b11-99ff-55429630e518 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Going to try to terminate instance {{(pid=117740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:27:22.681273 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f4161407-02fa-4b11-99ff-55429630e518 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 204 len: 0 microversion: 2.1 time: 0.126400 Jul 27 04:27:22.682317 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 275/539] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:27:22 2022] DELETE /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:27:22.693886 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-be5a3595-bc9e-430e-8c1c-b0e337e3dba4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:22.695199 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-be5a3595-bc9e-430e-8c1c-b0e337e3dba4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:22.703959 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-be5a3595-bc9e-430e-8c1c-b0e337e3dba4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:22.704552 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-be5a3595-bc9e-430e-8c1c-b0e337e3dba4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:22.706518 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-be5a3595-bc9e-430e-8c1c-b0e337e3dba4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:22.707102 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-be5a3595-bc9e-430e-8c1c-b0e337e3dba4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:22.729713 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-bc67204f-e47b-440f-8ba3-78d853a484f7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:22.738160 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-bc67204f-e47b-440f-8ba3-78d853a484f7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.257070 Jul 27 04:27:22.739074 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 265/540] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:22 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:22.852532 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-be5a3595-bc9e-430e-8c1c-b0e337e3dba4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:22.860305 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-be5a3595-bc9e-430e-8c1c-b0e337e3dba4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1576 microversion: 2.1 time: 0.173443 Jul 27 04:27:22.860892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 276/541] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:22 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:23.759563 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e516b7c8-973f-4817-8837-837c39ad6acb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:23.760475 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e516b7c8-973f-4817-8837-837c39ad6acb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:23.766993 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e516b7c8-973f-4817-8837-837c39ad6acb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:23.767442 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e516b7c8-973f-4817-8837-837c39ad6acb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:23.768209 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e516b7c8-973f-4817-8837-837c39ad6acb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:23.768638 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e516b7c8-973f-4817-8837-837c39ad6acb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:23.882527 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8a693d22-23fe-47a8-8735-2acdbc0679f7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:23.883122 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-8a693d22-23fe-47a8-8735-2acdbc0679f7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:23.890223 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8a693d22-23fe-47a8-8735-2acdbc0679f7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:23.890668 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8a693d22-23fe-47a8-8735-2acdbc0679f7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:23.891519 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8a693d22-23fe-47a8-8735-2acdbc0679f7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:23.891947 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8a693d22-23fe-47a8-8735-2acdbc0679f7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:23.978622 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e516b7c8-973f-4817-8837-837c39ad6acb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:23.986317 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e516b7c8-973f-4817-8837-837c39ad6acb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.230581 Jul 27 04:27:23.987069 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 266/542] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:23 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:24.049109 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-8a693d22-23fe-47a8-8735-2acdbc0679f7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:24.056731 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8a693d22-23fe-47a8-8735-2acdbc0679f7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1576 microversion: 2.1 time: 0.178028 Jul 27 04:27:24.057640 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 277/543] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:23 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:27:25.007567 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ffd6347e-ade8-4594-8d32-5aa78f5b6fcc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:25.008176 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ffd6347e-ade8-4594-8d32-5aa78f5b6fcc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:25.014663 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ffd6347e-ade8-4594-8d32-5aa78f5b6fcc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:25.015118 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ffd6347e-ade8-4594-8d32-5aa78f5b6fcc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:25.015882 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ffd6347e-ade8-4594-8d32-5aa78f5b6fcc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:25.016320 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ffd6347e-ade8-4594-8d32-5aa78f5b6fcc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:25.078258 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b54926cb-8577-420b-97d8-259737a355cd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:25.079258 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b54926cb-8577-420b-97d8-259737a355cd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:25.085946 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b54926cb-8577-420b-97d8-259737a355cd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:25.086447 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b54926cb-8577-420b-97d8-259737a355cd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:25.087220 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b54926cb-8577-420b-97d8-259737a355cd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:25.087650 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b54926cb-8577-420b-97d8-259737a355cd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:25.160793 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ffd6347e-ade8-4594-8d32-5aa78f5b6fcc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:25.169416 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ffd6347e-ade8-4594-8d32-5aa78f5b6fcc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.165723 Jul 27 04:27:25.170020 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 267/544] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:25 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:25.182595 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b54926cb-8577-420b-97d8-259737a355cd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:25.192606 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b54926cb-8577-420b-97d8-259737a355cd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 200 len: 1509 microversion: 2.1 time: 0.118216 Jul 27 04:27:25.206012 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 278/545] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:25 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 1509 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:25.206252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-373db42e-2262-4c62-9211-a6665ee28231 req-e6e04787-2032-4af8-bae5-9c4d21e3e412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1dc2957-3830-46b6-b50c-05806cb4e259", "name": "network-vif-deleted", "tag": "c8fba684-60c7-4ea8-891e-bf8550d838f9"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:25.210790 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-373db42e-2262-4c62-9211-a6665ee28231 req-e6e04787-2032-4af8-bae5-9c4d21e3e412 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:25.211251 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-373db42e-2262-4c62-9211-a6665ee28231 req-e6e04787-2032-4af8-bae5-9c4d21e3e412 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:25.224777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-373db42e-2262-4c62-9211-a6665ee28231 req-e6e04787-2032-4af8-bae5-9c4d21e3e412 service nova] Creating event network-vif-deleted:c8fba684-60c7-4ea8-891e-bf8550d838f9 for instance a1dc2957-3830-46b6-b50c-05806cb4e259 on hv-cinder-85098 Jul 27 04:27:25.230627 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-373db42e-2262-4c62-9211-a6665ee28231 req-e6e04787-2032-4af8-bae5-9c4d21e3e412 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034448 Jul 27 04:27:25.231241 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 268/546] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:27:26.191557 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-05b2bbe9-6285-4320-81ae-b50b1e63b13f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:26.192254 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-05b2bbe9-6285-4320-81ae-b50b1e63b13f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:26.199160 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-05b2bbe9-6285-4320-81ae-b50b1e63b13f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:26.199602 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-05b2bbe9-6285-4320-81ae-b50b1e63b13f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:26.200358 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-05b2bbe9-6285-4320-81ae-b50b1e63b13f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:26.200785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-05b2bbe9-6285-4320-81ae-b50b1e63b13f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:26.219656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-577b526d-763f-4fbb-a151-902ddd81682b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:26.221086 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-577b526d-763f-4fbb-a151-902ddd81682b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:26.228968 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-577b526d-763f-4fbb-a151-902ddd81682b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:26.229435 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-577b526d-763f-4fbb-a151-902ddd81682b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:26.230225 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-577b526d-763f-4fbb-a151-902ddd81682b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:26.230658 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-577b526d-763f-4fbb-a151-902ddd81682b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:26.246781 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-577b526d-763f-4fbb-a151-902ddd81682b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] HTTP exception thrown: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-577b526d-763f-4fbb-a151-902ddd81682b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Request method failure captured: Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 HTTP/1.1 Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L3hSmP2SOJhV3F-1jSFLV_MUh7OtRi5bPIi_AQ8z2gIQtYCReiWttEnQGEB0fYGbdTgL1YGHqTPw5NiZeSuQEe9b_vcpfkxtpsrP-j9J1SgbA2wnuBzLmLQNP9gkGZkTnxnq_EN5F3_0GmwApFpSw2qY8ByBk2Y3pbT38MPT_QQoEQ Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: 3825c2630a4f47e0b029bd0c90875108 Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-TestVolumeBootPattern-77715254 Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:27:26.248429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:27:26.251260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:27:26.251260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-TestVolumeBootPattern-77715254 Jul 27 04:27:26.251260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: 3825c2630a4f47e0b029bd0c90875108 Jul 27 04:27:26.251260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-TestVolumeBootPattern-77715254 Jul 27 04:27:26.251260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-TestVolumeBootPattern-77715254-project Jul 27 04:27:26.251260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:27:26.251260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:27:26.251260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: eea5b08eede4409484dc2f4305b5298a Jul 27 04:27:26.251260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-TestVolumeBootPattern-77715254-project Jul 27 04:27:26.251260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:27:26.251260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:27:26.251260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': 'a1dc2957-3830-46b6-b50c-05806cb4e259'} Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:27:26.252214 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:27:26.253766 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:27:26.256156 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-577b526d-763f-4fbb-a151-902ddd81682b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Returning 404 to user: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:27:26.256156 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-577b526d-763f-4fbb-a151-902ddd81682b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 404 len: 111 microversion: 2.1 time: 0.035185 Jul 27 04:27:26.256156 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 269/547] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:26 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:27:26.353089 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-951917392", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1427079078", "security_groups": [{"name": "tempest-secgroup-smoke-245786739"}], "block_device_mapping_v2": [{"uuid": "dc2eb467-1706-42f1-b720-0c16bf31e5e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87fd5d56-0e62-4bdf-a522-882668de212a"}]}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:26.353378 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-05b2bbe9-6285-4320-81ae-b50b1e63b13f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:26.361961 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-05b2bbe9-6285-4320-81ae-b50b1e63b13f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.174247 Jul 27 04:27:26.362489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 279/548] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:26 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:26.465090 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] validate_networks() for [('87fd5d56-0e62-4bdf-a522-882668de212a', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:27:26.829312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:27:26.829728 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:27:26.830233 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:27:26.830644 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:27:26.831049 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:27:26.840315 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:26.840752 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:26.841545 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:26.842001 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:26.858633 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Getting quotas for project 3825c2630a4f47e0b029bd0c90875108. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:27:26.862525 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Getting quotas for user eea5b08eede4409484dc2f4305b5298a and project 3825c2630a4f47e0b029bd0c90875108. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:27:26.922719 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:27:26.924788 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc2eb467-1706-42f1-b720-0c16bf31e5e4',volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:27:27.050451 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-b60e08b1-d90c-4fb8-b963-6a922b7c5502 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.701144 Jul 27 04:27:27.051098 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 270/549] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:27:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 04:27:27.061856 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4180ac31-549c-4384-bbd8-fc08e7f913a7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:27.062560 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4180ac31-549c-4384-bbd8-fc08e7f913a7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:27.117336 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4180ac31-549c-4384-bbd8-fc08e7f913a7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:27.124487 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4180ac31-549c-4384-bbd8-fc08e7f913a7 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1094 microversion: 2.1 time: 0.066493 Jul 27 04:27:27.125311 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 280/550] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:27 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:27:27.384003 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-628815b0-90d2-437d-9233-e686e19bf916 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:27.384614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-628815b0-90d2-437d-9233-e686e19bf916 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:27.391931 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-628815b0-90d2-437d-9233-e686e19bf916 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:27.392383 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-628815b0-90d2-437d-9233-e686e19bf916 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:27.393155 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-628815b0-90d2-437d-9233-e686e19bf916 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:27.393610 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-628815b0-90d2-437d-9233-e686e19bf916 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:27.530728 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-628815b0-90d2-437d-9233-e686e19bf916 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:27.538420 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-628815b0-90d2-437d-9233-e686e19bf916 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.158807 Jul 27 04:27:27.538986 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 271/551] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:27 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:28.145350 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d8534802-4ecb-474a-b25b-3f4b60aeb7cf tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:28.146657 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d8534802-4ecb-474a-b25b-3f4b60aeb7cf tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:28.154627 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d8534802-4ecb-474a-b25b-3f4b60aeb7cf tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:28.155470 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d8534802-4ecb-474a-b25b-3f4b60aeb7cf tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:28.156425 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d8534802-4ecb-474a-b25b-3f4b60aeb7cf tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:28.156855 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d8534802-4ecb-474a-b25b-3f4b60aeb7cf tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:28.246449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d8534802-4ecb-474a-b25b-3f4b60aeb7cf tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:28.254530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d8534802-4ecb-474a-b25b-3f4b60aeb7cf tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1210 microversion: 2.1 time: 0.113206 Jul 27 04:27:28.255312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 281/552] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:28 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1210 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:28.560219 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3b3f495e-f42f-4c6a-a9bd-a726663257db tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:28.561560 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-3b3f495e-f42f-4c6a-a9bd-a726663257db tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:28.568145 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3b3f495e-f42f-4c6a-a9bd-a726663257db tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:28.569351 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3b3f495e-f42f-4c6a-a9bd-a726663257db tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:28.570185 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3b3f495e-f42f-4c6a-a9bd-a726663257db tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:28.570816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3b3f495e-f42f-4c6a-a9bd-a726663257db tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:28.708294 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-3b3f495e-f42f-4c6a-a9bd-a726663257db tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:28.716763 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-3b3f495e-f42f-4c6a-a9bd-a726663257db tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.160641 Jul 27 04:27:28.717535 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 272/553] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:28 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:29.275988 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-46a0cabd-1d83-461b-bc34-9b07baa41dfc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:29.276541 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-46a0cabd-1d83-461b-bc34-9b07baa41dfc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:29.282978 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-46a0cabd-1d83-461b-bc34-9b07baa41dfc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:29.283426 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-46a0cabd-1d83-461b-bc34-9b07baa41dfc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:29.284182 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-46a0cabd-1d83-461b-bc34-9b07baa41dfc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:29.284617 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-46a0cabd-1d83-461b-bc34-9b07baa41dfc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:29.412142 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-46a0cabd-1d83-461b-bc34-9b07baa41dfc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:29.420072 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-46a0cabd-1d83-461b-bc34-9b07baa41dfc tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1277 microversion: 2.1 time: 0.148054 Jul 27 04:27:29.420636 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 282/554] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:29 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:29.737874 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-aa755352-0f64-44b9-b2d9-ef59bfa395cc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:29.738510 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-aa755352-0f64-44b9-b2d9-ef59bfa395cc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:29.745469 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-aa755352-0f64-44b9-b2d9-ef59bfa395cc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:29.745907 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-aa755352-0f64-44b9-b2d9-ef59bfa395cc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:29.746720 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-aa755352-0f64-44b9-b2d9-ef59bfa395cc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:29.747147 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-aa755352-0f64-44b9-b2d9-ef59bfa395cc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:29.888348 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-aa755352-0f64-44b9-b2d9-ef59bfa395cc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:29.896620 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-aa755352-0f64-44b9-b2d9-ef59bfa395cc tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.162352 Jul 27 04:27:29.897195 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 273/555] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:29 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:30.425910 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-5dbbad7c-bf96-42e8-a06e-4b54dbb57884 req-f9b7ffca-7854-4680-96e5-9344689100ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebadd469-2167-427c-99e3-da0d244d3c43", "tag": "4df25964-f8b6-4580-9b35-69da892880e3"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:30.442293 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3ffd35ce-47d4-44b6-ae32-c4f92800b0b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:30.442489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-5dbbad7c-bf96-42e8-a06e-4b54dbb57884 req-f9b7ffca-7854-4680-96e5-9344689100ba service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:30.442907 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-5dbbad7c-bf96-42e8-a06e-4b54dbb57884 req-f9b7ffca-7854-4680-96e5-9344689100ba service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:30.443023 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-3ffd35ce-47d4-44b6-ae32-c4f92800b0b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:30.459739 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-5dbbad7c-bf96-42e8-a06e-4b54dbb57884 req-f9b7ffca-7854-4680-96e5-9344689100ba service nova] Creating event network-changed:4df25964-f8b6-4580-9b35-69da892880e3 for instance ebadd469-2167-427c-99e3-da0d244d3c43 on hv-cinder-85098 Jul 27 04:27:30.462266 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3ffd35ce-47d4-44b6-ae32-c4f92800b0b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:30.462719 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3ffd35ce-47d4-44b6-ae32-c4f92800b0b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:30.466369 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3ffd35ce-47d4-44b6-ae32-c4f92800b0b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:30.466526 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-5dbbad7c-bf96-42e8-a06e-4b54dbb57884 req-f9b7ffca-7854-4680-96e5-9344689100ba service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046563 Jul 27 04:27:30.466656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3ffd35ce-47d4-44b6-ae32-c4f92800b0b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:30.467688 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 283/556] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:27:30.623178 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-3ffd35ce-47d4-44b6-ae32-c4f92800b0b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:30.630649 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-3ffd35ce-47d4-44b6-ae32-c4f92800b0b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1265 microversion: 2.1 time: 0.193727 Jul 27 04:27:30.631212 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 274/557] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:30 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:27:30.920381 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3bc7e160-3505-4af4-8694-3f4a19351f25 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:30.921085 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3bc7e160-3505-4af4-8694-3f4a19351f25 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:30.927221 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3bc7e160-3505-4af4-8694-3f4a19351f25 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:30.927676 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3bc7e160-3505-4af4-8694-3f4a19351f25 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:30.928450 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3bc7e160-3505-4af4-8694-3f4a19351f25 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:30.928884 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3bc7e160-3505-4af4-8694-3f4a19351f25 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:31.133210 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3bc7e160-3505-4af4-8694-3f4a19351f25 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:31.141781 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3bc7e160-3505-4af4-8694-3f4a19351f25 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1508 microversion: 2.1 time: 0.225817 Jul 27 04:27:31.142378 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 284/558] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:30 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1508 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:31.162663 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0fd7fc38-26f3-47cc-a005-b6e07c5a2532 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:31.163244 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0fd7fc38-26f3-47cc-a005-b6e07c5a2532 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:31.169916 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0fd7fc38-26f3-47cc-a005-b6e07c5a2532 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:31.170401 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0fd7fc38-26f3-47cc-a005-b6e07c5a2532 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:31.171173 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0fd7fc38-26f3-47cc-a005-b6e07c5a2532 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:31.171607 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0fd7fc38-26f3-47cc-a005-b6e07c5a2532 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:31.248356 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0fd7fc38-26f3-47cc-a005-b6e07c5a2532 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "POST /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6/action" status: 202 len: 0 microversion: 2.1 time: 0.089660 Jul 27 04:27:31.248963 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 275/559] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:27:31 2022] POST /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:27:31.257065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4d55cae8-6aac-4b7b-9dd5-3006fd667bb3 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:31.257673 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4d55cae8-6aac-4b7b-9dd5-3006fd667bb3 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:31.264966 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d55cae8-6aac-4b7b-9dd5-3006fd667bb3 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:31.265412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d55cae8-6aac-4b7b-9dd5-3006fd667bb3 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:31.266239 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d55cae8-6aac-4b7b-9dd5-3006fd667bb3 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:31.266670 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d55cae8-6aac-4b7b-9dd5-3006fd667bb3 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:31.536712 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4d55cae8-6aac-4b7b-9dd5-3006fd667bb3 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:31.545561 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4d55cae8-6aac-4b7b-9dd5-3006fd667bb3 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1516 microversion: 2.1 time: 0.292120 Jul 27 04:27:31.546124 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 285/560] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:31 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1516 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:31.652216 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c6efb6a4-3c78-436c-98da-353dc8cf8f2b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:31.652675 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c6efb6a4-3c78-436c-98da-353dc8cf8f2b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:31.658749 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c6efb6a4-3c78-436c-98da-353dc8cf8f2b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:31.659195 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c6efb6a4-3c78-436c-98da-353dc8cf8f2b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:31.659953 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c6efb6a4-3c78-436c-98da-353dc8cf8f2b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:31.660378 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c6efb6a4-3c78-436c-98da-353dc8cf8f2b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:31.803050 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c6efb6a4-3c78-436c-98da-353dc8cf8f2b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:31.819687 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c6efb6a4-3c78-436c-98da-353dc8cf8f2b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1265 microversion: 2.1 time: 0.171682 Jul 27 04:27:31.820367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 276/561] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:31 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:32.573029 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4fb13f94-2ec1-4d55-81de-83dae42f15a9 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:32.573762 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4fb13f94-2ec1-4d55-81de-83dae42f15a9 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:32.580385 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4fb13f94-2ec1-4d55-81de-83dae42f15a9 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:32.580840 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4fb13f94-2ec1-4d55-81de-83dae42f15a9 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:32.581598 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4fb13f94-2ec1-4d55-81de-83dae42f15a9 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:32.582052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4fb13f94-2ec1-4d55-81de-83dae42f15a9 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:32.715962 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4fb13f94-2ec1-4d55-81de-83dae42f15a9 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:32.723416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4fb13f94-2ec1-4d55-81de-83dae42f15a9 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1574 microversion: 2.1 time: 0.154640 Jul 27 04:27:32.723983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 286/562] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:32 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:32.843713 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-82868ed7-699b-45a7-9638-fdf714797328 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:32.844486 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-82868ed7-699b-45a7-9638-fdf714797328 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:32.851357 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-82868ed7-699b-45a7-9638-fdf714797328 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:32.851807 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-82868ed7-699b-45a7-9638-fdf714797328 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:32.852585 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-82868ed7-699b-45a7-9638-fdf714797328 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:32.853018 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-82868ed7-699b-45a7-9638-fdf714797328 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:32.872840 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:32.996554 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-82868ed7-699b-45a7-9638-fdf714797328 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:33.004320 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-82868ed7-699b-45a7-9638-fdf714797328 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1265 microversion: 2.1 time: 0.164666 Jul 27 04:27:33.004993 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 277/563] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:32 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:33.290418 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-0df64c56-918f-4e0c-b5e8-6ee1b7f0efc5 req-7f75e8c6-128a-4649-b8d3-b6151ced8356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5496cce3-6266-4650-84ba-9e01e99cbea6", "name": "network-vif-unplugged", "status": "completed", "tag": "69fb12ed-2ec4-4ba8-a2dd-7b56427bd104"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:33.300857 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-0df64c56-918f-4e0c-b5e8-6ee1b7f0efc5 req-7f75e8c6-128a-4649-b8d3-b6151ced8356 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:33.301302 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-0df64c56-918f-4e0c-b5e8-6ee1b7f0efc5 req-7f75e8c6-128a-4649-b8d3-b6151ced8356 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:33.313332 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-0df64c56-918f-4e0c-b5e8-6ee1b7f0efc5 req-7f75e8c6-128a-4649-b8d3-b6151ced8356 service nova] Creating event network-vif-unplugged:69fb12ed-2ec4-4ba8-a2dd-7b56427bd104 for instance 5496cce3-6266-4650-84ba-9e01e99cbea6 on hv-cinder-85098 Jul 27 04:27:33.318315 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-0df64c56-918f-4e0c-b5e8-6ee1b7f0efc5 req-7f75e8c6-128a-4649-b8d3-b6151ced8356 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094453 Jul 27 04:27:33.318958 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 287/564] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:27:33.745325 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-47491409-3f30-47dd-9d5b-5d16cdb7931b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:33.745852 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-47491409-3f30-47dd-9d5b-5d16cdb7931b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:33.751814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-47491409-3f30-47dd-9d5b-5d16cdb7931b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:33.752251 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-47491409-3f30-47dd-9d5b-5d16cdb7931b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:33.753004 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-47491409-3f30-47dd-9d5b-5d16cdb7931b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:33.753426 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-47491409-3f30-47dd-9d5b-5d16cdb7931b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:33.881404 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-47491409-3f30-47dd-9d5b-5d16cdb7931b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:33.888968 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-47491409-3f30-47dd-9d5b-5d16cdb7931b tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1574 microversion: 2.1 time: 0.148237 Jul 27 04:27:33.889528 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 278/565] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:33 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:34.027236 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-29365116-f452-4b62-83ba-a970eaa67769 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:34.027853 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-29365116-f452-4b62-83ba-a970eaa67769 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:34.033960 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-29365116-f452-4b62-83ba-a970eaa67769 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:34.034429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-29365116-f452-4b62-83ba-a970eaa67769 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:34.035183 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-29365116-f452-4b62-83ba-a970eaa67769 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:34.035611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-29365116-f452-4b62-83ba-a970eaa67769 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:34.163115 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-29365116-f452-4b62-83ba-a970eaa67769 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:34.170647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-29365116-f452-4b62-83ba-a970eaa67769 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1265 microversion: 2.1 time: 0.148822 Jul 27 04:27:34.171217 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 288/566] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:34 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:34.909930 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f7e109df-7fb1-4735-a21a-9ca84540120a tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:34.910551 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f7e109df-7fb1-4735-a21a-9ca84540120a tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:34.917649 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f7e109df-7fb1-4735-a21a-9ca84540120a tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:34.918103 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f7e109df-7fb1-4735-a21a-9ca84540120a tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:34.918856 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f7e109df-7fb1-4735-a21a-9ca84540120a tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:34.919279 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f7e109df-7fb1-4735-a21a-9ca84540120a tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:35.051893 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f7e109df-7fb1-4735-a21a-9ca84540120a tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:35.060265 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f7e109df-7fb1-4735-a21a-9ca84540120a tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1574 microversion: 2.1 time: 0.154226 Jul 27 04:27:35.060822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 279/567] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:34 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:35.191983 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-74ee2325-6d97-4096-952b-784c5faf38f1 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:35.192761 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-74ee2325-6d97-4096-952b-784c5faf38f1 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:35.199875 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-74ee2325-6d97-4096-952b-784c5faf38f1 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:35.200355 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-74ee2325-6d97-4096-952b-784c5faf38f1 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:35.201122 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-74ee2325-6d97-4096-952b-784c5faf38f1 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:35.201560 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-74ee2325-6d97-4096-952b-784c5faf38f1 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:35.331487 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-74ee2325-6d97-4096-952b-784c5faf38f1 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:35.339667 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-74ee2325-6d97-4096-952b-784c5faf38f1 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1265 microversion: 2.1 time: 0.151509 Jul 27 04:27:35.340224 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 289/568] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:35 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:36.082131 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e5590c10-161c-4194-99a9-ddc12ff47615 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:36.082747 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e5590c10-161c-4194-99a9-ddc12ff47615 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:36.090084 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e5590c10-161c-4194-99a9-ddc12ff47615 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:36.090534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e5590c10-161c-4194-99a9-ddc12ff47615 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:36.091302 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e5590c10-161c-4194-99a9-ddc12ff47615 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:36.091737 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e5590c10-161c-4194-99a9-ddc12ff47615 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:36.220819 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e5590c10-161c-4194-99a9-ddc12ff47615 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:36.228871 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e5590c10-161c-4194-99a9-ddc12ff47615 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1574 microversion: 2.1 time: 0.150501 Jul 27 04:27:36.229443 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 280/569] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:36 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:36.359991 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-395e84b7-9f3b-4ca5-8a03-4fef7a8624fa tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:36.360597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-395e84b7-9f3b-4ca5-8a03-4fef7a8624fa tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:36.366960 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-395e84b7-9f3b-4ca5-8a03-4fef7a8624fa tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:36.367401 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-395e84b7-9f3b-4ca5-8a03-4fef7a8624fa tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:36.368152 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-395e84b7-9f3b-4ca5-8a03-4fef7a8624fa tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:36.368584 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-395e84b7-9f3b-4ca5-8a03-4fef7a8624fa tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:36.503056 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-395e84b7-9f3b-4ca5-8a03-4fef7a8624fa tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:36.511088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-395e84b7-9f3b-4ca5-8a03-4fef7a8624fa tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1265 microversion: 2.1 time: 0.154907 Jul 27 04:27:36.511683 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 290/570] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:36 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:37.250336 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-a026e405-7f11-4667-ae83-02103b775119 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:37.250980 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-a026e405-7f11-4667-ae83-02103b775119 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:37.252828 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:37.253471 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=6 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:37.263868 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a026e405-7f11-4667-ae83-02103b775119 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:37.264323 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a026e405-7f11-4667-ae83-02103b775119 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:37.265098 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a026e405-7f11-4667-ae83-02103b775119 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:37.265535 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a026e405-7f11-4667-ae83-02103b775119 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:37.532756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0a079102-4e31-4be0-b2aa-05a7a320c042 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:37.533420 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0a079102-4e31-4be0-b2aa-05a7a320c042 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:37.535498 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:37.541589 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0a079102-4e31-4be0-b2aa-05a7a320c042 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:37.542037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0a079102-4e31-4be0-b2aa-05a7a320c042 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:37.542818 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0a079102-4e31-4be0-b2aa-05a7a320c042 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:37.543253 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0a079102-4e31-4be0-b2aa-05a7a320c042 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:37.562261 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:37.642807 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-a026e405-7f11-4667-ae83-02103b775119 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:37.651097 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-a026e405-7f11-4667-ae83-02103b775119 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1574 microversion: 2.1 time: 0.403885 Jul 27 04:27:37.655021 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 281/571] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:37 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1574 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:37.685136 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0a079102-4e31-4be0-b2aa-05a7a320c042 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:37.692489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0a079102-4e31-4be0-b2aa-05a7a320c042 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1265 microversion: 2.1 time: 0.163678 Jul 27 04:27:37.693053 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 291/572] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:37 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:27:38.672975 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9bdcd236-9a29-4d38-ad1c-067ae5c96ae7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:38.673613 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9bdcd236-9a29-4d38-ad1c-067ae5c96ae7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:38.680042 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bdcd236-9a29-4d38-ad1c-067ae5c96ae7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:38.680491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bdcd236-9a29-4d38-ad1c-067ae5c96ae7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:38.681278 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bdcd236-9a29-4d38-ad1c-067ae5c96ae7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:38.681953 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9bdcd236-9a29-4d38-ad1c-067ae5c96ae7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:38.714501 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-049cdd5e-56a5-4ba0-be56-8693ef8a7c64 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:38.715155 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-049cdd5e-56a5-4ba0-be56-8693ef8a7c64 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:38.717454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:38.723237 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-049cdd5e-56a5-4ba0-be56-8693ef8a7c64 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:38.723712 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-049cdd5e-56a5-4ba0-be56-8693ef8a7c64 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:38.724759 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-049cdd5e-56a5-4ba0-be56-8693ef8a7c64 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:38.724944 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-049cdd5e-56a5-4ba0-be56-8693ef8a7c64 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:38.811588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9bdcd236-9a29-4d38-ad1c-067ae5c96ae7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:38.819124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9bdcd236-9a29-4d38-ad1c-067ae5c96ae7 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1574 microversion: 2.1 time: 0.149952 Jul 27 04:27:38.819694 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 282/573] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:38 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:38.861598 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-049cdd5e-56a5-4ba0-be56-8693ef8a7c64 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:38.869057 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-049cdd5e-56a5-4ba0-be56-8693ef8a7c64 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1265 microversion: 2.1 time: 0.159010 Jul 27 04:27:38.869776 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 292/574] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:38 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:27:39.841212 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4227781b-db4a-428b-a757-6bea82f2691f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:39.841825 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4227781b-db4a-428b-a757-6bea82f2691f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:39.848393 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4227781b-db4a-428b-a757-6bea82f2691f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:39.848845 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4227781b-db4a-428b-a757-6bea82f2691f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:39.849608 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4227781b-db4a-428b-a757-6bea82f2691f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:39.850079 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4227781b-db4a-428b-a757-6bea82f2691f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:39.891261 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-05fd8552-c769-4dba-bbc9-e599142839ef tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:39.891920 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-05fd8552-c769-4dba-bbc9-e599142839ef tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:39.898609 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-05fd8552-c769-4dba-bbc9-e599142839ef tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:39.899058 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-05fd8552-c769-4dba-bbc9-e599142839ef tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:39.899830 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-05fd8552-c769-4dba-bbc9-e599142839ef tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:39.900917 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-05fd8552-c769-4dba-bbc9-e599142839ef tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:39.982784 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4227781b-db4a-428b-a757-6bea82f2691f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:39.990405 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4227781b-db4a-428b-a757-6bea82f2691f tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1574 microversion: 2.1 time: 0.153653 Jul 27 04:27:39.991131 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 283/575] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:39 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:40.035839 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-05fd8552-c769-4dba-bbc9-e599142839ef tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:40.043490 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-05fd8552-c769-4dba-bbc9-e599142839ef tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1265 microversion: 2.1 time: 0.156163 Jul 27 04:27:40.044063 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 293/576] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:39 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:27:41.011467 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-fe869636-dac7-49e6-ab47-d7228054ecc4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:41.012045 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-fe869636-dac7-49e6-ab47-d7228054ecc4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:41.014323 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:41.019471 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fe869636-dac7-49e6-ab47-d7228054ecc4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:41.019908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fe869636-dac7-49e6-ab47-d7228054ecc4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:41.020662 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fe869636-dac7-49e6-ab47-d7228054ecc4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:41.021088 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fe869636-dac7-49e6-ab47-d7228054ecc4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:41.064433 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e75a970b-7b62-408b-9676-052384fae9d6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:41.065061 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e75a970b-7b62-408b-9676-052384fae9d6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:41.071787 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e75a970b-7b62-408b-9676-052384fae9d6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:41.072315 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e75a970b-7b62-408b-9676-052384fae9d6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:41.073296 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e75a970b-7b62-408b-9676-052384fae9d6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:41.073735 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e75a970b-7b62-408b-9676-052384fae9d6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:41.162998 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-fe869636-dac7-49e6-ab47-d7228054ecc4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:41.171182 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-fe869636-dac7-49e6-ab47-d7228054ecc4 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1561 microversion: 2.1 time: 0.163543 Jul 27 04:27:41.171950 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 284/577] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:41 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:41.211169 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e75a970b-7b62-408b-9676-052384fae9d6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:41.220018 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e75a970b-7b62-408b-9676-052384fae9d6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1265 microversion: 2.1 time: 0.159099 Jul 27 04:27:41.220382 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 294/578] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:41 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:27:41.459841 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-437a8640-0b90-4488-8053-84d514ac6e48 req-468c0d24-b2a9-4e3d-89d0-a7695c7f1ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebadd469-2167-427c-99e3-da0d244d3c43", "name": "network-vif-plugged", "status": "completed", "tag": "4df25964-f8b6-4580-9b35-69da892880e3"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:41.474576 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-437a8640-0b90-4488-8053-84d514ac6e48 req-468c0d24-b2a9-4e3d-89d0-a7695c7f1ec9 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:41.475012 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-437a8640-0b90-4488-8053-84d514ac6e48 req-468c0d24-b2a9-4e3d-89d0-a7695c7f1ec9 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:41.486802 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-437a8640-0b90-4488-8053-84d514ac6e48 req-468c0d24-b2a9-4e3d-89d0-a7695c7f1ec9 service nova] Creating event network-vif-plugged:4df25964-f8b6-4580-9b35-69da892880e3 for instance ebadd469-2167-427c-99e3-da0d244d3c43 on hv-cinder-85098 Jul 27 04:27:41.491689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-437a8640-0b90-4488-8053-84d514ac6e48 req-468c0d24-b2a9-4e3d-89d0-a7695c7f1ec9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035454 Jul 27 04:27:41.492441 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 285/579] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:27:42.241010 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4af23196-0076-40cf-8e1a-66553fa84cae tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:42.241619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4af23196-0076-40cf-8e1a-66553fa84cae tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:42.248989 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4af23196-0076-40cf-8e1a-66553fa84cae tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:42.249435 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4af23196-0076-40cf-8e1a-66553fa84cae tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:42.250232 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4af23196-0076-40cf-8e1a-66553fa84cae tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:42.250679 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4af23196-0076-40cf-8e1a-66553fa84cae tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:42.389749 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4af23196-0076-40cf-8e1a-66553fa84cae tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:42.397087 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4af23196-0076-40cf-8e1a-66553fa84cae tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1265 microversion: 2.1 time: 0.159923 Jul 27 04:27:42.397658 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 295/580] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:42 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:43.419920 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-142c90a9-7047-45df-b39a-0ad20f1c2b93 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:43.420635 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-142c90a9-7047-45df-b39a-0ad20f1c2b93 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:43.426890 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-142c90a9-7047-45df-b39a-0ad20f1c2b93 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:43.427334 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-142c90a9-7047-45df-b39a-0ad20f1c2b93 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:43.428095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-142c90a9-7047-45df-b39a-0ad20f1c2b93 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:43.428577 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-142c90a9-7047-45df-b39a-0ad20f1c2b93 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:43.461030 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c467f427-eb17-4bff-af87-18e9f1733dfd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:43.461663 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c467f427-eb17-4bff-af87-18e9f1733dfd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:43.469569 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c467f427-eb17-4bff-af87-18e9f1733dfd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:43.470078 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c467f427-eb17-4bff-af87-18e9f1733dfd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:43.470855 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c467f427-eb17-4bff-af87-18e9f1733dfd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:43.471290 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c467f427-eb17-4bff-af87-18e9f1733dfd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:43.496413 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c467f427-eb17-4bff-af87-18e9f1733dfd tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/ips" status: 200 len: 151 microversion: 2.20 time: 0.039131 Jul 27 04:27:43.496978 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 296/581] 10.222.0.46 () {60 vars in 1289 bytes} [Wed Jul 27 04:27:43 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 04:27:43.513911 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-9382a723-20dc-4682-ae21-403b47df224e req-4ebcf0e7-dfc4-4d00-9dec-58042d7a7f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5496cce3-6266-4650-84ba-9e01e99cbea6", "name": "network-vif-plugged", "status": "completed", "tag": "69fb12ed-2ec4-4ba8-a2dd-7b56427bd104"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:43.525491 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-9382a723-20dc-4682-ae21-403b47df224e req-4ebcf0e7-dfc4-4d00-9dec-58042d7a7f76 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:43.526221 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-9382a723-20dc-4682-ae21-403b47df224e req-4ebcf0e7-dfc4-4d00-9dec-58042d7a7f76 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:43.538499 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-9382a723-20dc-4682-ae21-403b47df224e req-4ebcf0e7-dfc4-4d00-9dec-58042d7a7f76 service nova] Creating event network-vif-plugged:69fb12ed-2ec4-4ba8-a2dd-7b56427bd104 for instance 5496cce3-6266-4650-84ba-9e01e99cbea6 on hv-cinder-85098 Jul 27 04:27:43.544675 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-9382a723-20dc-4682-ae21-403b47df224e req-4ebcf0e7-dfc4-4d00-9dec-58042d7a7f76 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033518 Jul 27 04:27:43.547312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 297/582] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:27:43.567243 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-142c90a9-7047-45df-b39a-0ad20f1c2b93 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:43.575408 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-142c90a9-7047-45df-b39a-0ad20f1c2b93 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1451 microversion: 2.1 time: 0.160961 Jul 27 04:27:43.576293 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 286/583] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:43 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:27:43.595601 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a2353695-90eb-4f6e-a18c-dd4bdbec6e57 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:43.596514 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a2353695-90eb-4f6e-a18c-dd4bdbec6e57 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:43.602930 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a2353695-90eb-4f6e-a18c-dd4bdbec6e57 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:43.603949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a2353695-90eb-4f6e-a18c-dd4bdbec6e57 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:43.604722 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a2353695-90eb-4f6e-a18c-dd4bdbec6e57 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:43.605160 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a2353695-90eb-4f6e-a18c-dd4bdbec6e57 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:43.747120 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a2353695-90eb-4f6e-a18c-dd4bdbec6e57 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:43.755840 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a2353695-90eb-4f6e-a18c-dd4bdbec6e57 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1451 microversion: 2.1 time: 0.164505 Jul 27 04:27:43.756649 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 298/584] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:27:43 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:27:45.414346 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-a2eb428a-fc83-49fe-865f-d4e473a8f154 req-5fe3baf5-61b4-4dc8-8bea-2c380569a082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebadd469-2167-427c-99e3-da0d244d3c43", "tag": "4df25964-f8b6-4580-9b35-69da892880e3"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:45.423824 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-a2eb428a-fc83-49fe-865f-d4e473a8f154 req-5fe3baf5-61b4-4dc8-8bea-2c380569a082 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:45.424259 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-a2eb428a-fc83-49fe-865f-d4e473a8f154 req-5fe3baf5-61b4-4dc8-8bea-2c380569a082 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:45.435652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-a2eb428a-fc83-49fe-865f-d4e473a8f154 req-5fe3baf5-61b4-4dc8-8bea-2c380569a082 service nova] Creating event network-changed:4df25964-f8b6-4580-9b35-69da892880e3 for instance ebadd469-2167-427c-99e3-da0d244d3c43 on hv-cinder-85098 Jul 27 04:27:45.440410 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-a2eb428a-fc83-49fe-865f-d4e473a8f154 req-5fe3baf5-61b4-4dc8-8bea-2c380569a082 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085986 Jul 27 04:27:45.441161 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 287/585] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:27:46.011561 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-848fafee-b167-40df-a42c-167b23650c9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:27:46.012735 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-848fafee-b167-40df-a42c-167b23650c9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:46.018917 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-848fafee-b167-40df-a42c-167b23650c9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:46.019511 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-848fafee-b167-40df-a42c-167b23650c9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:46.020293 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-848fafee-b167-40df-a42c-167b23650c9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:46.020764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-848fafee-b167-40df-a42c-167b23650c9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:46.044523 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-848fafee-b167-40df-a42c-167b23650c9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lazy-loading 'flavor' on Instance uuid ea65d581-c4a6-4764-93c8-5ca7b0fe08fa {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:27:46.232479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-848fafee-b167-40df-a42c-167b23650c9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "POST /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/action" status: 202 len: 0 microversion: 2.20 time: 0.225864 Jul 27 04:27:46.233527 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 299/586] 10.222.0.46 () {62 vars in 1319 bytes} [Wed Jul 27 04:27:46 2022] POST /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:27:46.242224 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4e5df3bd-5eec-4770-a11d-26f6748cc22e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:46.242826 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4e5df3bd-5eec-4770-a11d-26f6748cc22e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:46.249743 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e5df3bd-5eec-4770-a11d-26f6748cc22e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:46.250181 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e5df3bd-5eec-4770-a11d-26f6748cc22e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:46.250913 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e5df3bd-5eec-4770-a11d-26f6748cc22e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:46.251343 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e5df3bd-5eec-4770-a11d-26f6748cc22e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:46.393576 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4e5df3bd-5eec-4770-a11d-26f6748cc22e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:46.402086 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4e5df3bd-5eec-4770-a11d-26f6748cc22e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:46.403636 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4e5df3bd-5eec-4770-a11d-26f6748cc22e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:46.404826 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4e5df3bd-5eec-4770-a11d-26f6748cc22e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1721 microversion: 2.20 time: 0.167382 Jul 27 04:27:46.405386 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 288/587] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:46 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:47.429054 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-681bf64e-5f8b-4bf3-b4f7-9553f843d352 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:47.429748 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-681bf64e-5f8b-4bf3-b4f7-9553f843d352 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:47.437042 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-681bf64e-5f8b-4bf3-b4f7-9553f843d352 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:47.437491 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-681bf64e-5f8b-4bf3-b4f7-9553f843d352 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:47.438285 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-681bf64e-5f8b-4bf3-b4f7-9553f843d352 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:47.438721 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-681bf64e-5f8b-4bf3-b4f7-9553f843d352 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:47.570405 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-681bf64e-5f8b-4bf3-b4f7-9553f843d352 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:47.578413 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-681bf64e-5f8b-4bf3-b4f7-9553f843d352 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:47.579909 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-681bf64e-5f8b-4bf3-b4f7-9553f843d352 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:47.581047 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-681bf64e-5f8b-4bf3-b4f7-9553f843d352 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1721 microversion: 2.20 time: 0.156739 Jul 27 04:27:47.581604 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 300/588] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:47 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:48.605522 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8706a7ba-1e02-4bc0-9821-9d0856991d67 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:48.606151 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8706a7ba-1e02-4bc0-9821-9d0856991d67 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:48.612709 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8706a7ba-1e02-4bc0-9821-9d0856991d67 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:48.613145 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8706a7ba-1e02-4bc0-9821-9d0856991d67 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:48.613898 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8706a7ba-1e02-4bc0-9821-9d0856991d67 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:48.614350 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8706a7ba-1e02-4bc0-9821-9d0856991d67 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:48.740732 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8706a7ba-1e02-4bc0-9821-9d0856991d67 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:48.748773 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8706a7ba-1e02-4bc0-9821-9d0856991d67 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:48.750301 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8706a7ba-1e02-4bc0-9821-9d0856991d67 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:48.751440 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8706a7ba-1e02-4bc0-9821-9d0856991d67 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1721 microversion: 2.20 time: 0.150443 Jul 27 04:27:48.751994 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 289/589] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:48 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:49.775687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3839585a-10aa-45d9-96c9-c0d676148d8f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:49.776225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3839585a-10aa-45d9-96c9-c0d676148d8f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:49.782632 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3839585a-10aa-45d9-96c9-c0d676148d8f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:49.783057 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3839585a-10aa-45d9-96c9-c0d676148d8f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:49.783803 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3839585a-10aa-45d9-96c9-c0d676148d8f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:49.784227 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3839585a-10aa-45d9-96c9-c0d676148d8f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:49.908620 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3839585a-10aa-45d9-96c9-c0d676148d8f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:49.917252 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3839585a-10aa-45d9-96c9-c0d676148d8f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:49.918778 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3839585a-10aa-45d9-96c9-c0d676148d8f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:49.919918 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3839585a-10aa-45d9-96c9-c0d676148d8f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1721 microversion: 2.20 time: 0.148811 Jul 27 04:27:49.920463 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 301/590] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:49 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:27:50.942934 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-760717bd-b29d-43cf-9a5f-1d67c8cf314d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:50.943561 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-760717bd-b29d-43cf-9a5f-1d67c8cf314d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:50.950825 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-760717bd-b29d-43cf-9a5f-1d67c8cf314d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:50.951266 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-760717bd-b29d-43cf-9a5f-1d67c8cf314d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:50.952023 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-760717bd-b29d-43cf-9a5f-1d67c8cf314d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:50.952451 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-760717bd-b29d-43cf-9a5f-1d67c8cf314d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:51.089809 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-760717bd-b29d-43cf-9a5f-1d67c8cf314d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:51.097853 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-760717bd-b29d-43cf-9a5f-1d67c8cf314d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:51.099407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-760717bd-b29d-43cf-9a5f-1d67c8cf314d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:51.100603 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-760717bd-b29d-43cf-9a5f-1d67c8cf314d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1721 microversion: 2.20 time: 0.161516 Jul 27 04:27:51.101383 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 290/591] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:50 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:52.123247 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ee0e8e22-b59d-4f76-9703-ab20dd4f7ecf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:52.123838 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ee0e8e22-b59d-4f76-9703-ab20dd4f7ecf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:52.130931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ee0e8e22-b59d-4f76-9703-ab20dd4f7ecf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:52.131379 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ee0e8e22-b59d-4f76-9703-ab20dd4f7ecf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:52.132148 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ee0e8e22-b59d-4f76-9703-ab20dd4f7ecf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:52.132583 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ee0e8e22-b59d-4f76-9703-ab20dd4f7ecf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:52.263221 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ee0e8e22-b59d-4f76-9703-ab20dd4f7ecf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:52.271106 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ee0e8e22-b59d-4f76-9703-ab20dd4f7ecf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:52.272601 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ee0e8e22-b59d-4f76-9703-ab20dd4f7ecf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:52.273746 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ee0e8e22-b59d-4f76-9703-ab20dd4f7ecf tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1721 microversion: 2.20 time: 0.154428 Jul 27 04:27:52.274349 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 302/592] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:52 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:53.297150 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4e85bd9c-4fc9-4779-8fbc-1837b7bccfc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:53.297761 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4e85bd9c-4fc9-4779-8fbc-1837b7bccfc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:53.304671 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e85bd9c-4fc9-4779-8fbc-1837b7bccfc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:53.305331 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e85bd9c-4fc9-4779-8fbc-1837b7bccfc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:53.307070 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e85bd9c-4fc9-4779-8fbc-1837b7bccfc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:53.307962 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4e85bd9c-4fc9-4779-8fbc-1837b7bccfc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:53.447218 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4e85bd9c-4fc9-4779-8fbc-1837b7bccfc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:53.456553 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4e85bd9c-4fc9-4779-8fbc-1837b7bccfc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:53.458353 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4e85bd9c-4fc9-4779-8fbc-1837b7bccfc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:53.460471 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4e85bd9c-4fc9-4779-8fbc-1837b7bccfc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1721 microversion: 2.20 time: 0.167084 Jul 27 04:27:53.461385 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 291/593] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:53 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:54.487191 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d21e0257-5b53-4bd8-9714-1eea828828c5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:54.487797 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d21e0257-5b53-4bd8-9714-1eea828828c5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:54.494323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d21e0257-5b53-4bd8-9714-1eea828828c5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:54.494764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d21e0257-5b53-4bd8-9714-1eea828828c5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:54.495527 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d21e0257-5b53-4bd8-9714-1eea828828c5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:54.495959 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d21e0257-5b53-4bd8-9714-1eea828828c5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:54.623014 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d21e0257-5b53-4bd8-9714-1eea828828c5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:54.630710 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d21e0257-5b53-4bd8-9714-1eea828828c5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:54.632202 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d21e0257-5b53-4bd8-9714-1eea828828c5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:54.633337 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d21e0257-5b53-4bd8-9714-1eea828828c5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1721 microversion: 2.20 time: 0.150114 Jul 27 04:27:54.633888 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 303/594] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:54 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:55.656907 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-268c07f1-699b-45f4-8df5-c176b486e96b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:55.657526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-268c07f1-699b-45f4-8df5-c176b486e96b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:55.663953 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-268c07f1-699b-45f4-8df5-c176b486e96b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:55.664396 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-268c07f1-699b-45f4-8df5-c176b486e96b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:55.665152 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-268c07f1-699b-45f4-8df5-c176b486e96b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:55.665828 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-268c07f1-699b-45f4-8df5-c176b486e96b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:55.792303 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-268c07f1-699b-45f4-8df5-c176b486e96b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:55.800222 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-268c07f1-699b-45f4-8df5-c176b486e96b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:55.801724 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-268c07f1-699b-45f4-8df5-c176b486e96b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:55.802899 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-268c07f1-699b-45f4-8df5-c176b486e96b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1721 microversion: 2.20 time: 0.149866 Jul 27 04:27:55.803468 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 292/595] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:55 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:56.826631 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e0cd031d-5c6d-4963-8bd3-eb411560bbb2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:56.827242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e0cd031d-5c6d-4963-8bd3-eb411560bbb2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:56.833705 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e0cd031d-5c6d-4963-8bd3-eb411560bbb2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:56.834207 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e0cd031d-5c6d-4963-8bd3-eb411560bbb2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:56.834978 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e0cd031d-5c6d-4963-8bd3-eb411560bbb2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:56.835413 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e0cd031d-5c6d-4963-8bd3-eb411560bbb2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:56.965489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e0cd031d-5c6d-4963-8bd3-eb411560bbb2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:56.973407 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e0cd031d-5c6d-4963-8bd3-eb411560bbb2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:56.974951 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e0cd031d-5c6d-4963-8bd3-eb411560bbb2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:56.976103 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e0cd031d-5c6d-4963-8bd3-eb411560bbb2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1742 microversion: 2.20 time: 0.153414 Jul 27 04:27:56.976657 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 304/596] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:56 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:58.003857 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f1470e49-7ac1-40fa-b0ae-c213cbd9f8b5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:58.004466 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f1470e49-7ac1-40fa-b0ae-c213cbd9f8b5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:58.011462 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f1470e49-7ac1-40fa-b0ae-c213cbd9f8b5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:58.011966 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f1470e49-7ac1-40fa-b0ae-c213cbd9f8b5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:58.012733 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f1470e49-7ac1-40fa-b0ae-c213cbd9f8b5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:58.013160 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f1470e49-7ac1-40fa-b0ae-c213cbd9f8b5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:58.144011 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f1470e49-7ac1-40fa-b0ae-c213cbd9f8b5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:58.152338 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f1470e49-7ac1-40fa-b0ae-c213cbd9f8b5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:58.153827 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f1470e49-7ac1-40fa-b0ae-c213cbd9f8b5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:58.154987 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f1470e49-7ac1-40fa-b0ae-c213cbd9f8b5 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1742 microversion: 2.20 time: 0.158239 Jul 27 04:27:58.155547 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 293/597] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:57 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:27:59.178597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-69471803-3c11-4789-ac51-a13acf9bf533 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:27:59.179218 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-69471803-3c11-4789-ac51-a13acf9bf533 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:27:59.185831 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-69471803-3c11-4789-ac51-a13acf9bf533 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:59.186320 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-69471803-3c11-4789-ac51-a13acf9bf533 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:59.187096 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-69471803-3c11-4789-ac51-a13acf9bf533 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:27:59.187534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-69471803-3c11-4789-ac51-a13acf9bf533 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:27:59.350081 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-69471803-3c11-4789-ac51-a13acf9bf533 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:59.360034 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-69471803-3c11-4789-ac51-a13acf9bf533 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:59.361535 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-69471803-3c11-4789-ac51-a13acf9bf533 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:27:59.368981 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-69471803-3c11-4789-ac51-a13acf9bf533 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1737 microversion: 2.20 time: 0.194031 Jul 27 04:27:59.370022 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 305/598] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:27:59 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:00.396700 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3f98e290-df4f-4f17-816c-d7890654967d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:00.397295 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-3f98e290-df4f-4f17-816c-d7890654967d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:00.404635 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3f98e290-df4f-4f17-816c-d7890654967d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:00.405079 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3f98e290-df4f-4f17-816c-d7890654967d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:00.406068 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3f98e290-df4f-4f17-816c-d7890654967d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:00.406524 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3f98e290-df4f-4f17-816c-d7890654967d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:00.545021 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-3f98e290-df4f-4f17-816c-d7890654967d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:00.554060 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-3f98e290-df4f-4f17-816c-d7890654967d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:00.555812 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-3f98e290-df4f-4f17-816c-d7890654967d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:00.558052 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-3f98e290-df4f-4f17-816c-d7890654967d tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1737 microversion: 2.20 time: 0.165238 Jul 27 04:28:00.558925 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 294/599] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:00 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:01.490067 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-56421d88-5592-4ea4-b92d-ed6af4f4ab09 req-37539622-3852-49e7-a157-62550b4a30c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea65d581-c4a6-4764-93c8-5ca7b0fe08fa", "name": "network-vif-plugged", "status": "completed", "tag": "30ff67e2-9db2-4be1-97bd-8066d0658180"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:28:01.510980 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-56421d88-5592-4ea4-b92d-ed6af4f4ab09 req-37539622-3852-49e7-a157-62550b4a30c4 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:01.511434 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-56421d88-5592-4ea4-b92d-ed6af4f4ab09 req-37539622-3852-49e7-a157-62550b4a30c4 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:01.534875 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-56421d88-5592-4ea4-b92d-ed6af4f4ab09 req-37539622-3852-49e7-a157-62550b4a30c4 service nova] Creating event network-vif-plugged:30ff67e2-9db2-4be1-97bd-8066d0658180 for instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa on hv-cinder-85098 Jul 27 04:28:01.541256 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-56421d88-5592-4ea4-b92d-ed6af4f4ab09 req-37539622-3852-49e7-a157-62550b4a30c4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054251 Jul 27 04:28:01.542936 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 306/600] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:28:01.582522 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-19bc3791-2d72-4f85-a926-007ed794a444 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:01.582973 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-19bc3791-2d72-4f85-a926-007ed794a444 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:01.589611 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-19bc3791-2d72-4f85-a926-007ed794a444 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:01.590096 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-19bc3791-2d72-4f85-a926-007ed794a444 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:01.590843 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-19bc3791-2d72-4f85-a926-007ed794a444 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:01.591461 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-19bc3791-2d72-4f85-a926-007ed794a444 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:01.617224 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=100 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:28:01.753521 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-19bc3791-2d72-4f85-a926-007ed794a444 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:01.764074 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-19bc3791-2d72-4f85-a926-007ed794a444 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:01.766144 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-19bc3791-2d72-4f85-a926-007ed794a444 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:01.767614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-19bc3791-2d72-4f85-a926-007ed794a444 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1737 microversion: 2.20 time: 0.189188 Jul 27 04:28:01.781062 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 295/601] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:01 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:02.792244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-59d25c4b-ef31-4b41-a06b-54c4ded86c33 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:02.793211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-59d25c4b-ef31-4b41-a06b-54c4ded86c33 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:02.807102 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-59d25c4b-ef31-4b41-a06b-54c4ded86c33 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:02.807545 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-59d25c4b-ef31-4b41-a06b-54c4ded86c33 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:02.808318 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-59d25c4b-ef31-4b41-a06b-54c4ded86c33 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:02.808750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-59d25c4b-ef31-4b41-a06b-54c4ded86c33 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:02.972438 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-59d25c4b-ef31-4b41-a06b-54c4ded86c33 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:02.976807 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:28:02.990689 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-59d25c4b-ef31-4b41-a06b-54c4ded86c33 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:02.993392 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-59d25c4b-ef31-4b41-a06b-54c4ded86c33 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:02.995227 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-59d25c4b-ef31-4b41-a06b-54c4ded86c33 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1737 microversion: 2.20 time: 0.207809 Jul 27 04:28:02.995811 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 307/602] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:02 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:04.020295 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-618901f6-fec3-404d-a158-5a1f3222555a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:04.021364 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-618901f6-fec3-404d-a158-5a1f3222555a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:04.028816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-618901f6-fec3-404d-a158-5a1f3222555a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:04.029283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-618901f6-fec3-404d-a158-5a1f3222555a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:04.030105 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-618901f6-fec3-404d-a158-5a1f3222555a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:04.030548 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-618901f6-fec3-404d-a158-5a1f3222555a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:04.185329 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-618901f6-fec3-404d-a158-5a1f3222555a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:04.193750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-618901f6-fec3-404d-a158-5a1f3222555a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:04.195470 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-618901f6-fec3-404d-a158-5a1f3222555a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:04.196776 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-618901f6-fec3-404d-a158-5a1f3222555a tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1737 microversion: 2.20 time: 0.182262 Jul 27 04:28:04.212737 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 296/603] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:04 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:05.221260 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-18afcc9c-6f9b-4674-8f20-7440043764c3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:05.222658 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-18afcc9c-6f9b-4674-8f20-7440043764c3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:05.230822 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18afcc9c-6f9b-4674-8f20-7440043764c3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:05.231572 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18afcc9c-6f9b-4674-8f20-7440043764c3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:05.232643 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18afcc9c-6f9b-4674-8f20-7440043764c3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:05.233078 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-18afcc9c-6f9b-4674-8f20-7440043764c3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:05.394576 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-18afcc9c-6f9b-4674-8f20-7440043764c3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:05.404142 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-18afcc9c-6f9b-4674-8f20-7440043764c3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:05.408784 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-18afcc9c-6f9b-4674-8f20-7440043764c3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:05.410026 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-18afcc9c-6f9b-4674-8f20-7440043764c3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1737 microversion: 2.20 time: 0.192759 Jul 27 04:28:05.410604 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 308/604] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:05 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:05.722204 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e3a44d40-2f5a-4a3c-abe4-f320447c4b51 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:05.723324 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e3a44d40-2f5a-4a3c-abe4-f320447c4b51 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:05.730660 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e3a44d40-2f5a-4a3c-abe4-f320447c4b51 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:05.731412 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e3a44d40-2f5a-4a3c-abe4-f320447c4b51 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:05.732196 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e3a44d40-2f5a-4a3c-abe4-f320447c4b51 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:05.732759 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e3a44d40-2f5a-4a3c-abe4-f320447c4b51 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:05.757476 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e3a44d40-2f5a-4a3c-abe4-f320447c4b51 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285/ips" status: 200 len: 149 microversion: 2.1 time: 0.039116 Jul 27 04:28:05.764632 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 297/605] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Jul 27 04:28:05 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:28:06.433881 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0834dfac-5152-480f-a1d6-c605e7b1a173 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:06.435161 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0834dfac-5152-480f-a1d6-c605e7b1a173 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:06.442552 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0834dfac-5152-480f-a1d6-c605e7b1a173 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:06.443053 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0834dfac-5152-480f-a1d6-c605e7b1a173 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:06.443864 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0834dfac-5152-480f-a1d6-c605e7b1a173 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:06.444299 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0834dfac-5152-480f-a1d6-c605e7b1a173 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:06.603915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0834dfac-5152-480f-a1d6-c605e7b1a173 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:06.612597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0834dfac-5152-480f-a1d6-c605e7b1a173 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:06.614154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0834dfac-5152-480f-a1d6-c605e7b1a173 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:06.615327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0834dfac-5152-480f-a1d6-c605e7b1a173 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1737 microversion: 2.20 time: 0.186179 Jul 27 04:28:06.616269 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 309/606] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:06 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:07.185156 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-a5160434-e049-4096-88fd-7ac27fb1aa97 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dff9516a-25fe-49c2-8f3f-aa68031ddd4a"}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:28:07.187583 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-a5160434-e049-4096-88fd-7ac27fb1aa97 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:07.194654 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a5160434-e049-4096-88fd-7ac27fb1aa97 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:07.195104 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a5160434-e049-4096-88fd-7ac27fb1aa97 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:07.195883 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a5160434-e049-4096-88fd-7ac27fb1aa97 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:07.196310 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a5160434-e049-4096-88fd-7ac27fb1aa97 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:07.516667 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-a5160434-e049-4096-88fd-7ac27fb1aa97 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "POST /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335747 Jul 27 04:28:07.517295 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 298/607] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:28:07 2022] POST /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:28:07.640831 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d9f1b444-424b-449d-8671-14b005b4b6d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:07.642114 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d9f1b444-424b-449d-8671-14b005b4b6d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:07.648495 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d9f1b444-424b-449d-8671-14b005b4b6d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:07.648977 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d9f1b444-424b-449d-8671-14b005b4b6d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:07.650401 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d9f1b444-424b-449d-8671-14b005b4b6d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:07.651002 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d9f1b444-424b-449d-8671-14b005b4b6d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:07.804560 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d9f1b444-424b-449d-8671-14b005b4b6d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:07.813511 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d9f1b444-424b-449d-8671-14b005b4b6d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:07.815086 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d9f1b444-424b-449d-8671-14b005b4b6d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:07.816252 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d9f1b444-424b-449d-8671-14b005b4b6d2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1737 microversion: 2.20 time: 0.179315 Jul 27 04:28:07.823371 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 310/608] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:07 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:08.841945 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d10b4499-9f82-4992-b046-b7514697aaa3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:08.842706 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d10b4499-9f82-4992-b046-b7514697aaa3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:08.849414 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d10b4499-9f82-4992-b046-b7514697aaa3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:08.849863 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d10b4499-9f82-4992-b046-b7514697aaa3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:08.850795 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d10b4499-9f82-4992-b046-b7514697aaa3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:08.851241 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d10b4499-9f82-4992-b046-b7514697aaa3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:08.985578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d10b4499-9f82-4992-b046-b7514697aaa3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:08.993675 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d10b4499-9f82-4992-b046-b7514697aaa3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:08.995526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d10b4499-9f82-4992-b046-b7514697aaa3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:08.996690 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d10b4499-9f82-4992-b046-b7514697aaa3 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1719 microversion: 2.20 time: 0.159962 Jul 27 04:28:08.997252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 299/609] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:08 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:10.020592 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-daa782c6-77b8-45be-a24d-5b2076e208cb tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:10.021230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-daa782c6-77b8-45be-a24d-5b2076e208cb tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:10.023573 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=38 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:28:10.029624 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-daa782c6-77b8-45be-a24d-5b2076e208cb tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:10.030286 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-daa782c6-77b8-45be-a24d-5b2076e208cb tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:10.031049 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-daa782c6-77b8-45be-a24d-5b2076e208cb tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:10.031483 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-daa782c6-77b8-45be-a24d-5b2076e208cb tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:10.159788 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-daa782c6-77b8-45be-a24d-5b2076e208cb tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:10.167766 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-daa782c6-77b8-45be-a24d-5b2076e208cb tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:10.169283 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-daa782c6-77b8-45be-a24d-5b2076e208cb tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:10.170462 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-daa782c6-77b8-45be-a24d-5b2076e208cb tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1719 microversion: 2.20 time: 0.153814 Jul 27 04:28:10.171025 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 311/610] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:10 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:11.193530 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-a01cbe4b-21fa-455b-8f4e-b13aebf7fcc6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:11.194158 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-a01cbe4b-21fa-455b-8f4e-b13aebf7fcc6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:11.197336 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=32 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:28:11.203037 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a01cbe4b-21fa-455b-8f4e-b13aebf7fcc6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:11.203480 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a01cbe4b-21fa-455b-8f4e-b13aebf7fcc6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:11.204234 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a01cbe4b-21fa-455b-8f4e-b13aebf7fcc6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:11.204660 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a01cbe4b-21fa-455b-8f4e-b13aebf7fcc6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:11.335460 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-a01cbe4b-21fa-455b-8f4e-b13aebf7fcc6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:11.344015 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-a01cbe4b-21fa-455b-8f4e-b13aebf7fcc6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:11.345526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-a01cbe4b-21fa-455b-8f4e-b13aebf7fcc6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:11.346706 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-a01cbe4b-21fa-455b-8f4e-b13aebf7fcc6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1722 microversion: 2.20 time: 0.157031 Jul 27 04:28:11.347275 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 300/611] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:11 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:11.370316 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9294ed50-ee8a-4dec-b63e-a73121d503e1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c625aa95-a3bd-4990-973c-58bf90697dec"}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:28:11.372620 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-9294ed50-ee8a-4dec-b63e-a73121d503e1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:11.378786 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9294ed50-ee8a-4dec-b63e-a73121d503e1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:11.379230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9294ed50-ee8a-4dec-b63e-a73121d503e1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:11.379993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9294ed50-ee8a-4dec-b63e-a73121d503e1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:11.380416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9294ed50-ee8a-4dec-b63e-a73121d503e1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:11.473496 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-933187be-5400-46c5-8786-fca7cae9e184 req-bcf2cfe3-4792-4477-a81b-b3043c1a37e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea65d581-c4a6-4764-93c8-5ca7b0fe08fa", "name": "network-vif-unplugged", "status": "completed", "tag": "30ff67e2-9db2-4be1-97bd-8066d0658180"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:28:11.486009 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-933187be-5400-46c5-8786-fca7cae9e184 req-bcf2cfe3-4792-4477-a81b-b3043c1a37e8 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:11.493083 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-933187be-5400-46c5-8786-fca7cae9e184 req-bcf2cfe3-4792-4477-a81b-b3043c1a37e8 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:11.505159 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.compute.server_external_events [req-933187be-5400-46c5-8786-fca7cae9e184 req-bcf2cfe3-4792-4477-a81b-b3043c1a37e8 service nova] Unable to find a host for instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa. Dropping event network-vif-unplugged {{(pid=117739) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 27 04:28:11.506069 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-933187be-5400-46c5-8786-fca7cae9e184 req-bcf2cfe3-4792-4477-a81b-b3043c1a37e8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036452 Jul 27 04:28:11.507012 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 301/612] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 27 04:28:11.652957 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-9294ed50-ee8a-4dec-b63e-a73121d503e1 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "POST /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287334 Jul 27 04:28:11.653560 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 312/613] 10.222.0.46 () {62 vars in 1364 bytes} [Wed Jul 27 04:28:11 2022] POST /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/os-volume_attachments => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 04:28:11.773389 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0daf7116-ddb5-45d5-9571-d9fc69851abe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:11.773876 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0daf7116-ddb5-45d5-9571-d9fc69851abe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:11.780353 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0daf7116-ddb5-45d5-9571-d9fc69851abe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:11.780794 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0daf7116-ddb5-45d5-9571-d9fc69851abe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:11.781547 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0daf7116-ddb5-45d5-9571-d9fc69851abe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:11.781988 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0daf7116-ddb5-45d5-9571-d9fc69851abe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:12.011254 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0daf7116-ddb5-45d5-9571-d9fc69851abe tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/os-volume_attachments/c625aa95-a3bd-4990-973c-58bf90697dec" status: 202 len: 0 microversion: 2.20 time: 0.241661 Jul 27 04:28:12.011885 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 302/614] 10.222.0.46 () {60 vars in 1457 bytes} [Wed Jul 27 04:28:11 2022] DELETE /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/os-volume_attachments/c625aa95-a3bd-4990-973c-58bf90697dec => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:28:12.075514 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c61934c1-97ae-40b9-beb3-104cfd7d8f9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:28:12.076083 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c61934c1-97ae-40b9-beb3-104cfd7d8f9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:12.082120 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c61934c1-97ae-40b9-beb3-104cfd7d8f9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:12.082568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c61934c1-97ae-40b9-beb3-104cfd7d8f9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:12.083330 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c61934c1-97ae-40b9-beb3-104cfd7d8f9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:12.083764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c61934c1-97ae-40b9-beb3-104cfd7d8f9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:12.221926 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c61934c1-97ae-40b9-beb3-104cfd7d8f9c tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "POST /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/action" status: 202 len: 0 microversion: 2.20 time: 0.150604 Jul 27 04:28:12.222588 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 313/615] 10.222.0.46 () {62 vars in 1319 bytes} [Wed Jul 27 04:28:12 2022] POST /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:28:12.231439 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d62a5290-9628-4019-9055-ba5babc5af94 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:12.232183 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d62a5290-9628-4019-9055-ba5babc5af94 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:12.238748 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d62a5290-9628-4019-9055-ba5babc5af94 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:12.239202 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d62a5290-9628-4019-9055-ba5babc5af94 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:12.239969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d62a5290-9628-4019-9055-ba5babc5af94 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:12.240405 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d62a5290-9628-4019-9055-ba5babc5af94 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:12.371863 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d62a5290-9628-4019-9055-ba5babc5af94 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:12.379715 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d62a5290-9628-4019-9055-ba5babc5af94 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:12.381205 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d62a5290-9628-4019-9055-ba5babc5af94 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:12.382432 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d62a5290-9628-4019-9055-ba5babc5af94 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1670 microversion: 2.20 time: 0.155646 Jul 27 04:28:12.383027 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 303/616] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:12 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:13.405764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b92fe448-a348-4cd7-af25-0e8deb280d07 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:13.406399 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b92fe448-a348-4cd7-af25-0e8deb280d07 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:13.413353 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b92fe448-a348-4cd7-af25-0e8deb280d07 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:13.413796 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b92fe448-a348-4cd7-af25-0e8deb280d07 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:13.414608 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b92fe448-a348-4cd7-af25-0e8deb280d07 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:13.415063 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b92fe448-a348-4cd7-af25-0e8deb280d07 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:13.547102 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b92fe448-a348-4cd7-af25-0e8deb280d07 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:13.555181 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b92fe448-a348-4cd7-af25-0e8deb280d07 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:13.557866 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b92fe448-a348-4cd7-af25-0e8deb280d07 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:13.559133 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b92fe448-a348-4cd7-af25-0e8deb280d07 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1672 microversion: 2.20 time: 0.157896 Jul 27 04:28:13.559761 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 314/617] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:13 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:14.584082 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0e54f2f6-28fa-436f-84ca-2a085bfe6f4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:14.584696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0e54f2f6-28fa-436f-84ca-2a085bfe6f4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:14.591785 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0e54f2f6-28fa-436f-84ca-2a085bfe6f4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:14.592230 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0e54f2f6-28fa-436f-84ca-2a085bfe6f4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:14.592992 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0e54f2f6-28fa-436f-84ca-2a085bfe6f4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:14.593432 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0e54f2f6-28fa-436f-84ca-2a085bfe6f4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:14.729165 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-0e54f2f6-28fa-436f-84ca-2a085bfe6f4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:14.737430 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-0e54f2f6-28fa-436f-84ca-2a085bfe6f4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:14.739151 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-0e54f2f6-28fa-436f-84ca-2a085bfe6f4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:14.740309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0e54f2f6-28fa-436f-84ca-2a085bfe6f4e tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1728 microversion: 2.20 time: 0.160080 Jul 27 04:28:14.740876 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 304/618] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:14 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:15.073912 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c39a0776-a9c5-42ab-95ff-2476da1f18f3 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Action: 'create', calling method: .version_select at 0x7f21d5b8b670>, body: {"keypair": {"name": "tempest-keypair-990508937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfMe2rDF2298k8Y3dI3+Q3+5MUd3OYVwXRSME12mjw3GAxY8ZivrRTVk8NLzfSmWFU9WJ3Hfjg9uN8tBwbJZXxBJ4jkTcDhvXOyKnEIvIvrkLtbj3Yt096t+pgljKDRCA=="}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:28:15.090624 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-c39a0776-a9c5-42ab-95ff-2476da1f18f3 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for project aa51c6088dfa44df848e339d61bac664. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:28:15.094942 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-c39a0776-a9c5-42ab-95ff-2476da1f18f3 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for user 8cbc27f4433e4c48a75b216540a9022f and project aa51c6088dfa44df848e339d61bac664. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:28:15.127845 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c39a0776-a9c5-42ab-95ff-2476da1f18f3 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058117 Jul 27 04:28:15.128833 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 315/619] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Jul 27 04:28:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:28:15.764647 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8bede5dc-dc14-4e7a-bcd3-0f5fd551d1a7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:15.765259 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8bede5dc-dc14-4e7a-bcd3-0f5fd551d1a7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:15.772138 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8bede5dc-dc14-4e7a-bcd3-0f5fd551d1a7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:15.772980 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8bede5dc-dc14-4e7a-bcd3-0f5fd551d1a7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:15.774418 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8bede5dc-dc14-4e7a-bcd3-0f5fd551d1a7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:15.775837 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8bede5dc-dc14-4e7a-bcd3-0f5fd551d1a7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:15.956004 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8bede5dc-dc14-4e7a-bcd3-0f5fd551d1a7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:15.967077 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8bede5dc-dc14-4e7a-bcd3-0f5fd551d1a7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:15.970409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8bede5dc-dc14-4e7a-bcd3-0f5fd551d1a7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:15.972046 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8bede5dc-dc14-4e7a-bcd3-0f5fd551d1a7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1728 microversion: 2.20 time: 0.211324 Jul 27 04:28:15.972851 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 305/620] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:15 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:28:16.997419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8619ac00-4e11-4be4-8226-85a34a01c69b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:16.998072 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-8619ac00-4e11-4be4-8226-85a34a01c69b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:17.000376 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1681727871", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7941c677-84e1-4370-9083-08b3d22ae50b"}], "security_groups": [{"name": "tempest-securitygroup--1232993075"}], "key_name": "tempest-keypair-990508937", "user_data": "}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:28:17.004547 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8619ac00-4e11-4be4-8226-85a34a01c69b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:17.004921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8619ac00-4e11-4be4-8226-85a34a01c69b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:17.005799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8619ac00-4e11-4be4-8226-85a34a01c69b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:17.006270 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8619ac00-4e11-4be4-8226-85a34a01c69b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:17.124659 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] validate_networks() for [('7941c677-84e1-4370-9083-08b3d22ae50b', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:28:17.155348 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-8619ac00-4e11-4be4-8226-85a34a01c69b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:17.165761 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-8619ac00-4e11-4be4-8226-85a34a01c69b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:17.167566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-8619ac00-4e11-4be4-8226-85a34a01c69b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:17.168897 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8619ac00-4e11-4be4-8226-85a34a01c69b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1728 microversion: 2.20 time: 0.177111 Jul 27 04:28:17.169646 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 316/621] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:16 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:17.536326 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:28:17.536721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:28:17.537208 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:28:17.537617 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:28:17.538084 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:28:17.547247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:17.547696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:17.548501 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:17.548939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:17.570144 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for project aa51c6088dfa44df848e339d61bac664. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:28:17.575096 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for user 8cbc27f4433e4c48a75b216540a9022f and project aa51c6088dfa44df848e339d61bac664. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:28:17.588392 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:28:17.590973 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:28:17.646972 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c30c54aa-db64-48e2-906d-331d4ab2393a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.650854 Jul 27 04:28:17.658613 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e691449c-f619-4580-bd64-71a8e6b4ea68 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:17.659517 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e691449c-f619-4580-bd64-71a8e6b4ea68 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:17.664256 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 306/622] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:28:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:28:17.724785 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e691449c-f619-4580-bd64-71a8e6b4ea68 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:17.732833 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e691449c-f619-4580-bd64-71a8e6b4ea68 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1241 microversion: 2.1 time: 0.077977 Jul 27 04:28:17.747859 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 317/623] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:17 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:28:18.193278 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2d57618a-1eac-48e9-920a-b7b7ce51b296 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:18.194568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2d57618a-1eac-48e9-920a-b7b7ce51b296 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:18.202601 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2d57618a-1eac-48e9-920a-b7b7ce51b296 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:18.203044 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2d57618a-1eac-48e9-920a-b7b7ce51b296 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:18.203820 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2d57618a-1eac-48e9-920a-b7b7ce51b296 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:18.204251 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2d57618a-1eac-48e9-920a-b7b7ce51b296 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:18.350190 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2d57618a-1eac-48e9-920a-b7b7ce51b296 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:18.359043 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2d57618a-1eac-48e9-920a-b7b7ce51b296 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:18.360841 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2d57618a-1eac-48e9-920a-b7b7ce51b296 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:18.362223 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2d57618a-1eac-48e9-920a-b7b7ce51b296 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1728 microversion: 2.20 time: 0.173418 Jul 27 04:28:18.362775 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 307/624] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:18 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:18.756459 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ca84234a-c1ae-407d-ae7e-f305e404a3e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:18.757142 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ca84234a-c1ae-407d-ae7e-f305e404a3e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:18.765415 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ca84234a-c1ae-407d-ae7e-f305e404a3e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:18.765934 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ca84234a-c1ae-407d-ae7e-f305e404a3e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:18.767114 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ca84234a-c1ae-407d-ae7e-f305e404a3e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:18.767622 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ca84234a-c1ae-407d-ae7e-f305e404a3e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:18.842224 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ca84234a-c1ae-407d-ae7e-f305e404a3e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:18.854024 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ca84234a-c1ae-407d-ae7e-f305e404a3e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1245 microversion: 2.1 time: 0.099443 Jul 27 04:28:18.854024 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 318/625] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:18 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:28:19.502741 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b65178f8-76dd-4bcc-816c-a7eaa39c8d70 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:19.503333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-b65178f8-76dd-4bcc-816c-a7eaa39c8d70 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:19.510252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b65178f8-76dd-4bcc-816c-a7eaa39c8d70 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:19.510789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b65178f8-76dd-4bcc-816c-a7eaa39c8d70 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:19.511593 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b65178f8-76dd-4bcc-816c-a7eaa39c8d70 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:19.512030 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b65178f8-76dd-4bcc-816c-a7eaa39c8d70 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:19.648798 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-b65178f8-76dd-4bcc-816c-a7eaa39c8d70 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:19.657555 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-b65178f8-76dd-4bcc-816c-a7eaa39c8d70 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:19.659101 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-b65178f8-76dd-4bcc-816c-a7eaa39c8d70 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:19.660265 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-b65178f8-76dd-4bcc-816c-a7eaa39c8d70 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1728 microversion: 2.20 time: 0.278098 Jul 27 04:28:19.660855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 308/626] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:19 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1728 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:19.877933 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-29a8a837-092a-49b4-b98a-d6ef7478af54 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:19.878569 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-29a8a837-092a-49b4-b98a-d6ef7478af54 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:19.885596 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-29a8a837-092a-49b4-b98a-d6ef7478af54 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:19.886069 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-29a8a837-092a-49b4-b98a-d6ef7478af54 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:19.886975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-29a8a837-092a-49b4-b98a-d6ef7478af54 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:19.887420 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-29a8a837-092a-49b4-b98a-d6ef7478af54 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:19.959312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-29a8a837-092a-49b4-b98a-d6ef7478af54 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:19.967048 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-29a8a837-092a-49b4-b98a-d6ef7478af54 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1245 microversion: 2.1 time: 0.092917 Jul 27 04:28:19.967641 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 319/627] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:19 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:28:20.683666 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4036a75c-f174-4a7a-8698-6b050c7ce370 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:20.684334 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4036a75c-f174-4a7a-8698-6b050c7ce370 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:20.691264 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4036a75c-f174-4a7a-8698-6b050c7ce370 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:20.691713 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4036a75c-f174-4a7a-8698-6b050c7ce370 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:20.692589 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4036a75c-f174-4a7a-8698-6b050c7ce370 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:20.693025 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4036a75c-f174-4a7a-8698-6b050c7ce370 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:20.828688 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4036a75c-f174-4a7a-8698-6b050c7ce370 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:20.836871 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4036a75c-f174-4a7a-8698-6b050c7ce370 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:20.838926 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4036a75c-f174-4a7a-8698-6b050c7ce370 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:20.840453 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4036a75c-f174-4a7a-8698-6b050c7ce370 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1728 microversion: 2.20 time: 0.161337 Jul 27 04:28:20.841279 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 309/628] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:20 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:20.988359 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-10058388-d339-436e-9f14-c3edf14a76a5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:20.989049 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-10058388-d339-436e-9f14-c3edf14a76a5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:20.996374 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-10058388-d339-436e-9f14-c3edf14a76a5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:20.996811 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-10058388-d339-436e-9f14-c3edf14a76a5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:20.997572 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-10058388-d339-436e-9f14-c3edf14a76a5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:20.998014 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-10058388-d339-436e-9f14-c3edf14a76a5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:21.059762 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-10058388-d339-436e-9f14-c3edf14a76a5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:21.067539 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-10058388-d339-436e-9f14-c3edf14a76a5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1245 microversion: 2.1 time: 0.083035 Jul 27 04:28:21.068103 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 320/629] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:20 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:28:21.863765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5f44814e-3755-4fb8-b803-a0b5c37163a8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:21.864536 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-5f44814e-3755-4fb8-b803-a0b5c37163a8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:21.871994 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5f44814e-3755-4fb8-b803-a0b5c37163a8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:21.872511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5f44814e-3755-4fb8-b803-a0b5c37163a8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:21.873448 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5f44814e-3755-4fb8-b803-a0b5c37163a8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:21.874069 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5f44814e-3755-4fb8-b803-a0b5c37163a8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:21.879225 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:28:22.018784 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-5f44814e-3755-4fb8-b803-a0b5c37163a8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:22.027436 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-5f44814e-3755-4fb8-b803-a0b5c37163a8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:22.029061 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-5f44814e-3755-4fb8-b803-a0b5c37163a8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:22.030630 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-5f44814e-3755-4fb8-b803-a0b5c37163a8 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1728 microversion: 2.20 time: 0.170804 Jul 27 04:28:22.031451 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 310/630] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:21 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:22.088634 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-fadee016-b85f-472d-a564-dce2663e3939 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:22.089280 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-fadee016-b85f-472d-a564-dce2663e3939 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:22.096180 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fadee016-b85f-472d-a564-dce2663e3939 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:22.096628 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fadee016-b85f-472d-a564-dce2663e3939 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:22.097434 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fadee016-b85f-472d-a564-dce2663e3939 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:22.097863 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fadee016-b85f-472d-a564-dce2663e3939 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:22.166056 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-fadee016-b85f-472d-a564-dce2663e3939 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:22.173792 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-fadee016-b85f-472d-a564-dce2663e3939 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1245 microversion: 2.1 time: 0.089034 Jul 27 04:28:22.174554 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 321/631] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:22 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:28:23.055502 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f3b10b5a-3eca-4d7c-b21a-340b52ee1581 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:23.056097 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f3b10b5a-3eca-4d7c-b21a-340b52ee1581 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:23.063704 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f3b10b5a-3eca-4d7c-b21a-340b52ee1581 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:23.064151 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f3b10b5a-3eca-4d7c-b21a-340b52ee1581 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:23.064916 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f3b10b5a-3eca-4d7c-b21a-340b52ee1581 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:23.065355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f3b10b5a-3eca-4d7c-b21a-340b52ee1581 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:23.195431 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-2c027430-2dab-4a0e-8c21-d762adb6b88b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:23.196209 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-2c027430-2dab-4a0e-8c21-d762adb6b88b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:23.199297 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f3b10b5a-3eca-4d7c-b21a-340b52ee1581 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:23.203405 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2c027430-2dab-4a0e-8c21-d762adb6b88b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:23.203854 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2c027430-2dab-4a0e-8c21-d762adb6b88b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:23.204626 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2c027430-2dab-4a0e-8c21-d762adb6b88b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:23.205064 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2c027430-2dab-4a0e-8c21-d762adb6b88b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:23.207193 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f3b10b5a-3eca-4d7c-b21a-340b52ee1581 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:23.208710 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f3b10b5a-3eca-4d7c-b21a-340b52ee1581 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:23.209862 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f3b10b5a-3eca-4d7c-b21a-340b52ee1581 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1728 microversion: 2.20 time: 0.158704 Jul 27 04:28:23.210457 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 311/632] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:23 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:23.266793 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-2c027430-2dab-4a0e-8c21-d762adb6b88b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:23.270227 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:28:23.274834 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-2c027430-2dab-4a0e-8c21-d762adb6b88b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1245 microversion: 2.1 time: 0.083253 Jul 27 04:28:23.275395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 322/633] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:23 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:28:24.233551 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-14365f03-0001-4940-a0a1-b18b6e1a6180 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:24.234241 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-14365f03-0001-4940-a0a1-b18b6e1a6180 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:24.240746 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-14365f03-0001-4940-a0a1-b18b6e1a6180 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:24.241196 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-14365f03-0001-4940-a0a1-b18b6e1a6180 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:24.241963 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-14365f03-0001-4940-a0a1-b18b6e1a6180 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:24.242432 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-14365f03-0001-4940-a0a1-b18b6e1a6180 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:24.297150 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ba8bcb7d-bb6d-448e-af5a-632907c58c37 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:24.297768 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ba8bcb7d-bb6d-448e-af5a-632907c58c37 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:24.305144 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba8bcb7d-bb6d-448e-af5a-632907c58c37 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:24.305624 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba8bcb7d-bb6d-448e-af5a-632907c58c37 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:24.306421 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba8bcb7d-bb6d-448e-af5a-632907c58c37 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:24.307022 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba8bcb7d-bb6d-448e-af5a-632907c58c37 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:24.377003 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-14365f03-0001-4940-a0a1-b18b6e1a6180 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:24.381580 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ba8bcb7d-bb6d-448e-af5a-632907c58c37 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:24.385440 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-14365f03-0001-4940-a0a1-b18b6e1a6180 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:24.387079 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-14365f03-0001-4940-a0a1-b18b6e1a6180 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:24.388232 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-14365f03-0001-4940-a0a1-b18b6e1a6180 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1728 microversion: 2.20 time: 0.159195 Jul 27 04:28:24.388788 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 312/634] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:24 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:24.389365 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ba8bcb7d-bb6d-448e-af5a-632907c58c37 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1293 microversion: 2.1 time: 0.097446 Jul 27 04:28:24.390032 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 323/635] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:24 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:28:25.411688 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d87b8a3b-9ce8-4241-83b5-a0053ba90ebc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:25.412498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9553ebdb-d215-44fe-a32a-58b5c67bbbc6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:25.412988 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d87b8a3b-9ce8-4241-83b5-a0053ba90ebc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:25.413333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9553ebdb-d215-44fe-a32a-58b5c67bbbc6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:25.419778 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d87b8a3b-9ce8-4241-83b5-a0053ba90ebc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:25.420224 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d87b8a3b-9ce8-4241-83b5-a0053ba90ebc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:25.420361 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9553ebdb-d215-44fe-a32a-58b5c67bbbc6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:25.420692 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9553ebdb-d215-44fe-a32a-58b5c67bbbc6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:25.420999 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d87b8a3b-9ce8-4241-83b5-a0053ba90ebc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:25.421432 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d87b8a3b-9ce8-4241-83b5-a0053ba90ebc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:25.421624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9553ebdb-d215-44fe-a32a-58b5c67bbbc6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:25.422148 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9553ebdb-d215-44fe-a32a-58b5c67bbbc6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:25.576721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9553ebdb-d215-44fe-a32a-58b5c67bbbc6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:25.584975 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9553ebdb-d215-44fe-a32a-58b5c67bbbc6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1367 microversion: 2.1 time: 0.177168 Jul 27 04:28:25.585836 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 313/636] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:25 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:28:25.667554 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d87b8a3b-9ce8-4241-83b5-a0053ba90ebc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:25.676241 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d87b8a3b-9ce8-4241-83b5-a0053ba90ebc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:25.678002 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d87b8a3b-9ce8-4241-83b5-a0053ba90ebc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:25.679179 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d87b8a3b-9ce8-4241-83b5-a0053ba90ebc tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1728 microversion: 2.20 time: 0.271546 Jul 27 04:28:25.679934 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 324/637] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:25 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1728 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:28:26.164336 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-9bd6bebe-cc8a-4fbb-819f-1960eee25fe2 req-69c495d6-641a-4f85-b833-90bf026ee499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8efc620d-10a0-4def-b781-58225aaad7dd", "tag": "a797c33e-381b-4d81-ab52-f6fc5fa377b5"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:28:26.175847 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-9bd6bebe-cc8a-4fbb-819f-1960eee25fe2 req-69c495d6-641a-4f85-b833-90bf026ee499 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:26.176293 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-9bd6bebe-cc8a-4fbb-819f-1960eee25fe2 req-69c495d6-641a-4f85-b833-90bf026ee499 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:26.190987 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-9bd6bebe-cc8a-4fbb-819f-1960eee25fe2 req-69c495d6-641a-4f85-b833-90bf026ee499 service nova] Creating event network-changed:a797c33e-381b-4d81-ab52-f6fc5fa377b5 for instance 8efc620d-10a0-4def-b781-58225aaad7dd on hv-cinder-85098 Jul 27 04:28:26.197075 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-9bd6bebe-cc8a-4fbb-819f-1960eee25fe2 req-69c495d6-641a-4f85-b833-90bf026ee499 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036011 Jul 27 04:28:26.198051 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 314/638] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:28:26.607712 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9c3521e3-74fd-4eda-ab91-64128ee86972 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:26.608324 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-9c3521e3-74fd-4eda-ab91-64128ee86972 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:26.615054 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9c3521e3-74fd-4eda-ab91-64128ee86972 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:26.615501 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9c3521e3-74fd-4eda-ab91-64128ee86972 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:26.616261 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9c3521e3-74fd-4eda-ab91-64128ee86972 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:26.616685 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9c3521e3-74fd-4eda-ab91-64128ee86972 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:26.704880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2966c784-4e62-44e5-b25d-cd4f2f12a287 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:26.705583 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2966c784-4e62-44e5-b25d-cd4f2f12a287 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:26.711931 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2966c784-4e62-44e5-b25d-cd4f2f12a287 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:26.712377 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2966c784-4e62-44e5-b25d-cd4f2f12a287 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:26.713144 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2966c784-4e62-44e5-b25d-cd4f2f12a287 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:26.713581 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2966c784-4e62-44e5-b25d-cd4f2f12a287 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:26.750143 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-9c3521e3-74fd-4eda-ab91-64128ee86972 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:26.757803 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-9c3521e3-74fd-4eda-ab91-64128ee86972 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1367 microversion: 2.1 time: 0.154817 Jul 27 04:28:26.758600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 325/639] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:26 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:28:26.844161 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2966c784-4e62-44e5-b25d-cd4f2f12a287 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:26.851971 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2966c784-4e62-44e5-b25d-cd4f2f12a287 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:26.853489 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2966c784-4e62-44e5-b25d-cd4f2f12a287 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:26.854695 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2966c784-4e62-44e5-b25d-cd4f2f12a287 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1728 microversion: 2.20 time: 0.154592 Jul 27 04:28:26.855256 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 315/640] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:26 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:28:27.618955 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-a12f78a5-13fd-481e-8657-4ff3604d2471 req-65394a0d-434e-40a7-adef-dc8f5a37d1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea65d581-c4a6-4764-93c8-5ca7b0fe08fa", "name": "network-vif-plugged", "status": "completed", "tag": "30ff67e2-9db2-4be1-97bd-8066d0658180"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:28:27.630766 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-a12f78a5-13fd-481e-8657-4ff3604d2471 req-65394a0d-434e-40a7-adef-dc8f5a37d1f8 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:27.631356 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-a12f78a5-13fd-481e-8657-4ff3604d2471 req-65394a0d-434e-40a7-adef-dc8f5a37d1f8 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:27.644151 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-a12f78a5-13fd-481e-8657-4ff3604d2471 req-65394a0d-434e-40a7-adef-dc8f5a37d1f8 service nova] Creating event network-vif-plugged:30ff67e2-9db2-4be1-97bd-8066d0658180 for instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa on hv-cinder-85098 Jul 27 04:28:27.649156 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-a12f78a5-13fd-481e-8657-4ff3604d2471 req-65394a0d-434e-40a7-adef-dc8f5a37d1f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034241 Jul 27 04:28:27.650120 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 326/641] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:28:27.780129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-1f6381e5-1652-472b-ba49-8d6da421115b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:27.781386 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-1f6381e5-1652-472b-ba49-8d6da421115b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:27.783560 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:28:27.784589 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=6 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:28:27.791201 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1f6381e5-1652-472b-ba49-8d6da421115b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:27.792238 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1f6381e5-1652-472b-ba49-8d6da421115b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:27.792408 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1f6381e5-1652-472b-ba49-8d6da421115b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:27.793074 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1f6381e5-1652-472b-ba49-8d6da421115b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:27.874566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=6 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:28:27.880245 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d05c4167-7e39-40b1-8568-d83380835185 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:27.881416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d05c4167-7e39-40b1-8568-d83380835185 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:27.919431 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d05c4167-7e39-40b1-8568-d83380835185 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:27.920002 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d05c4167-7e39-40b1-8568-d83380835185 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:27.920897 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d05c4167-7e39-40b1-8568-d83380835185 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:27.921411 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d05c4167-7e39-40b1-8568-d83380835185 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:28.030282 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-1f6381e5-1652-472b-ba49-8d6da421115b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:28.038445 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-1f6381e5-1652-472b-ba49-8d6da421115b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1367 microversion: 2.1 time: 0.263630 Jul 27 04:28:28.039028 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 316/642] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:27 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:28:28.068471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d05c4167-7e39-40b1-8568-d83380835185 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:28.076934 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d05c4167-7e39-40b1-8568-d83380835185 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:28.078480 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d05c4167-7e39-40b1-8568-d83380835185 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:28.079634 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d05c4167-7e39-40b1-8568-d83380835185 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1728 microversion: 2.20 time: 0.206524 Jul 27 04:28:28.080198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 327/643] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:27 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1728 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:28:29.059758 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e1aaabac-7238-4b69-a3be-90228f25ff2b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:29.060298 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e1aaabac-7238-4b69-a3be-90228f25ff2b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:29.066794 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e1aaabac-7238-4b69-a3be-90228f25ff2b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:29.067239 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e1aaabac-7238-4b69-a3be-90228f25ff2b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:29.067999 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e1aaabac-7238-4b69-a3be-90228f25ff2b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:29.068431 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e1aaabac-7238-4b69-a3be-90228f25ff2b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:29.102930 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-196360f8-cd75-4f73-9bbb-ca8346ac4be0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:29.103569 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-196360f8-cd75-4f73-9bbb-ca8346ac4be0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:29.110189 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-196360f8-cd75-4f73-9bbb-ca8346ac4be0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:29.110630 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-196360f8-cd75-4f73-9bbb-ca8346ac4be0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:29.111395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-196360f8-cd75-4f73-9bbb-ca8346ac4be0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:29.111821 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-196360f8-cd75-4f73-9bbb-ca8346ac4be0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:29.226683 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e1aaabac-7238-4b69-a3be-90228f25ff2b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:29.235437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e1aaabac-7238-4b69-a3be-90228f25ff2b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1367 microversion: 2.1 time: 0.179460 Jul 27 04:28:29.248121 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 317/644] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:29 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:28:29.262388 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-196360f8-cd75-4f73-9bbb-ca8346ac4be0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:29.270598 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-196360f8-cd75-4f73-9bbb-ca8346ac4be0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:29.272091 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-196360f8-cd75-4f73-9bbb-ca8346ac4be0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:29.273267 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-196360f8-cd75-4f73-9bbb-ca8346ac4be0 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1728 microversion: 2.20 time: 0.174158 Jul 27 04:28:29.273807 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 328/645] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:29 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:28:30.256755 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-53e812b8-b780-4355-a5fd-637e13591c8a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:30.257300 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-53e812b8-b780-4355-a5fd-637e13591c8a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:30.264398 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-53e812b8-b780-4355-a5fd-637e13591c8a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:30.264832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-53e812b8-b780-4355-a5fd-637e13591c8a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:30.265583 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-53e812b8-b780-4355-a5fd-637e13591c8a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:30.266040 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-53e812b8-b780-4355-a5fd-637e13591c8a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:30.297029 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f682efdb-17a8-4422-bdd4-9afc69185ce6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:30.297649 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f682efdb-17a8-4422-bdd4-9afc69185ce6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:30.304346 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f682efdb-17a8-4422-bdd4-9afc69185ce6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:30.305038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f682efdb-17a8-4422-bdd4-9afc69185ce6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:30.305814 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f682efdb-17a8-4422-bdd4-9afc69185ce6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:30.306282 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f682efdb-17a8-4422-bdd4-9afc69185ce6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:30.395679 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-53e812b8-b780-4355-a5fd-637e13591c8a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:30.403997 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-53e812b8-b780-4355-a5fd-637e13591c8a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1367 microversion: 2.1 time: 0.151140 Jul 27 04:28:30.404660 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 318/646] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:30 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:28:30.441860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f682efdb-17a8-4422-bdd4-9afc69185ce6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:30.451171 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f682efdb-17a8-4422-bdd4-9afc69185ce6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:30.452681 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f682efdb-17a8-4422-bdd4-9afc69185ce6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:30.453849 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f682efdb-17a8-4422-bdd4-9afc69185ce6 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1715 microversion: 2.20 time: 0.160640 Jul 27 04:28:30.454455 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 329/647] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:28:30 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 04:28:31.424722 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2b0a1cbb-6796-4e17-97ff-ba9bb2d6c9cc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:31.425328 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2b0a1cbb-6796-4e17-97ff-ba9bb2d6c9cc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:31.431741 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2b0a1cbb-6796-4e17-97ff-ba9bb2d6c9cc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:31.432181 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2b0a1cbb-6796-4e17-97ff-ba9bb2d6c9cc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:31.432932 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2b0a1cbb-6796-4e17-97ff-ba9bb2d6c9cc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:31.433364 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2b0a1cbb-6796-4e17-97ff-ba9bb2d6c9cc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:31.565051 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2b0a1cbb-6796-4e17-97ff-ba9bb2d6c9cc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:31.573251 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2b0a1cbb-6796-4e17-97ff-ba9bb2d6c9cc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1367 microversion: 2.1 time: 0.152523 Jul 27 04:28:31.573819 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 319/648] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:31 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:28:31.638705 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-5eb91e94-8cea-41bd-8d17-c2e1f3eb1232 req-0088abf4-6ca7-42d6-afb1-acc174ad8ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8efc620d-10a0-4def-b781-58225aaad7dd", "name": "network-vif-plugged", "status": "completed", "tag": "a797c33e-381b-4d81-ab52-f6fc5fa377b5"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:28:31.649213 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-5eb91e94-8cea-41bd-8d17-c2e1f3eb1232 req-0088abf4-6ca7-42d6-afb1-acc174ad8ae0 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:31.649656 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-5eb91e94-8cea-41bd-8d17-c2e1f3eb1232 req-0088abf4-6ca7-42d6-afb1-acc174ad8ae0 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:31.661681 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-5eb91e94-8cea-41bd-8d17-c2e1f3eb1232 req-0088abf4-6ca7-42d6-afb1-acc174ad8ae0 service nova] Creating event network-vif-plugged:a797c33e-381b-4d81-ab52-f6fc5fa377b5 for instance 8efc620d-10a0-4def-b781-58225aaad7dd on hv-cinder-85098 Jul 27 04:28:31.666365 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-5eb91e94-8cea-41bd-8d17-c2e1f3eb1232 req-0088abf4-6ca7-42d6-afb1-acc174ad8ae0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032225 Jul 27 04:28:31.666950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 330/649] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:28:32.594426 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e618400f-3747-49f5-a75b-79aa07a51145 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:32.595061 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e618400f-3747-49f5-a75b-79aa07a51145 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:32.601520 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e618400f-3747-49f5-a75b-79aa07a51145 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:32.601964 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e618400f-3747-49f5-a75b-79aa07a51145 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:32.602750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e618400f-3747-49f5-a75b-79aa07a51145 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:32.603180 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e618400f-3747-49f5-a75b-79aa07a51145 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:32.728068 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e618400f-3747-49f5-a75b-79aa07a51145 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:32.735455 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e618400f-3747-49f5-a75b-79aa07a51145 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1367 microversion: 2.1 time: 0.144897 Jul 27 04:28:32.736016 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 320/650] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:32 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:28:33.757531 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e0e3eee1-007b-40c4-9f6c-2a41eb3c0b91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:33.758193 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e0e3eee1-007b-40c4-9f6c-2a41eb3c0b91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:33.765298 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e0e3eee1-007b-40c4-9f6c-2a41eb3c0b91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:33.765746 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e0e3eee1-007b-40c4-9f6c-2a41eb3c0b91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:33.766528 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e0e3eee1-007b-40c4-9f6c-2a41eb3c0b91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:33.766966 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e0e3eee1-007b-40c4-9f6c-2a41eb3c0b91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:33.900555 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e0e3eee1-007b-40c4-9f6c-2a41eb3c0b91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:28:33.908986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e0e3eee1-007b-40c4-9f6c-2a41eb3c0b91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1557 microversion: 2.1 time: 0.156250 Jul 27 04:28:33.909690 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 331/651] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:28:33 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:28:33.929235 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9904a904-0449-4a75-98d0-93752a429dba tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:28:33.929812 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9904a904-0449-4a75-98d0-93752a429dba tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:28:33.936914 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9904a904-0449-4a75-98d0-93752a429dba tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:33.937356 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9904a904-0449-4a75-98d0-93752a429dba tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:33.938146 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9904a904-0449-4a75-98d0-93752a429dba tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:33.938576 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9904a904-0449-4a75-98d0-93752a429dba tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:34.013232 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9904a904-0449-4a75-98d0-93752a429dba tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087740 Jul 27 04:28:34.013819 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 321/652] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Jul 27 04:28:33 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:28:35.176111 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-9525ba04-9375-4253-87a2-681e13cfd266 req-8d49bc8e-af0f-4a77-ab42-093d93d70d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8efc620d-10a0-4def-b781-58225aaad7dd", "tag": "a797c33e-381b-4d81-ab52-f6fc5fa377b5"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:28:35.186774 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-9525ba04-9375-4253-87a2-681e13cfd266 req-8d49bc8e-af0f-4a77-ab42-093d93d70d82 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:28:35.187211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-9525ba04-9375-4253-87a2-681e13cfd266 req-8d49bc8e-af0f-4a77-ab42-093d93d70d82 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:28:35.198052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-9525ba04-9375-4253-87a2-681e13cfd266 req-8d49bc8e-af0f-4a77-ab42-093d93d70d82 service nova] Creating event network-changed:a797c33e-381b-4d81-ab52-f6fc5fa377b5 for instance 8efc620d-10a0-4def-b781-58225aaad7dd on hv-cinder-85098 Jul 27 04:28:35.203196 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-9525ba04-9375-4253-87a2-681e13cfd266 req-8d49bc8e-af0f-4a77-ab42-093d93d70d82 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030686 Jul 27 04:28:35.203788 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 332/653] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:03.495748 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:03.496505 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=65 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:03.502206 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-67859da4-a601-4a94-8dfc-76e3bc5af598 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:03.504532 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-67859da4-a601-4a94-8dfc-76e3bc5af598 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:03.512065 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-67859da4-a601-4a94-8dfc-76e3bc5af598 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:03.512608 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-67859da4-a601-4a94-8dfc-76e3bc5af598 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:03.513380 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-67859da4-a601-4a94-8dfc-76e3bc5af598 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:03.514212 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-67859da4-a601-4a94-8dfc-76e3bc5af598 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:03.543363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-67859da4-a601-4a94-8dfc-76e3bc5af598 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049021 Jul 27 04:29:03.543922 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 322/654] 10.222.0.46 () {60 vars in 1343 bytes} [Wed Jul 27 04:29:03 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:03.611719 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:03.613017 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=48 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:03.618467 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9bc0a13f-9fca-4600-be3f-e433347edb88 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:03.619062 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-9bc0a13f-9fca-4600-be3f-e433347edb88 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:03.626763 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9bc0a13f-9fca-4600-be3f-e433347edb88 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:03.627150 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9bc0a13f-9fca-4600-be3f-e433347edb88 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:03.627930 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9bc0a13f-9fca-4600-be3f-e433347edb88 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:03.628368 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9bc0a13f-9fca-4600-be3f-e433347edb88 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:03.654313 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-9bc0a13f-9fca-4600-be3f-e433347edb88 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Going to try to terminate instance {{(pid=117740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:29:03.729467 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-df9c625d-2152-4d44-a3b0-44deb05bcdc2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:03.730434 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-df9c625d-2152-4d44-a3b0-44deb05bcdc2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:03.737593 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-df9c625d-2152-4d44-a3b0-44deb05bcdc2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:03.738296 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-9bc0a13f-9fca-4600-be3f-e433347edb88 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 204 len: 0 microversion: 2.20 time: 0.128801 Jul 27 04:29:03.738794 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-df9c625d-2152-4d44-a3b0-44deb05bcdc2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:03.738978 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 333/655] 10.222.0.46 () {60 vars in 1280 bytes} [Wed Jul 27 04:29:03 2022] DELETE /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 04:29:03.743272 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-df9c625d-2152-4d44-a3b0-44deb05bcdc2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:03.743797 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-df9c625d-2152-4d44-a3b0-44deb05bcdc2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:03.744442 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-ebf303d9-34eb-4d26-a1f4-cc7d019c55e5 req-482094c8-7896-4d77-aeba-04543221b708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5496cce3-6266-4650-84ba-9e01e99cbea6", "tag": "69fb12ed-2ec4-4ba8-a2dd-7b56427bd104"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:03.753700 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-ebf303d9-34eb-4d26-a1f4-cc7d019c55e5 req-482094c8-7896-4d77-aeba-04543221b708 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:03.754488 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-ebf303d9-34eb-4d26-a1f4-cc7d019c55e5 req-482094c8-7896-4d77-aeba-04543221b708 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:03.766213 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-ebf303d9-34eb-4d26-a1f4-cc7d019c55e5 req-482094c8-7896-4d77-aeba-04543221b708 service nova] Creating event network-changed:69fb12ed-2ec4-4ba8-a2dd-7b56427bd104 for instance 5496cce3-6266-4650-84ba-9e01e99cbea6 on hv-cinder-85098 Jul 27 04:29:03.770997 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-ebf303d9-34eb-4d26-a1f4-cc7d019c55e5 req-482094c8-7896-4d77-aeba-04543221b708 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030520 Jul 27 04:29:03.771807 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 334/656] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:03.773953 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-df9c625d-2152-4d44-a3b0-44deb05bcdc2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Going to try to terminate instance {{(pid=117739) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:29:03.777902 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f2bbda55-de30-4d80-be8a-14546df84e71 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:03.778619 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f2bbda55-de30-4d80-be8a-14546df84e71 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:03.785277 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f2bbda55-de30-4d80-be8a-14546df84e71 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:03.785717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f2bbda55-de30-4d80-be8a-14546df84e71 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:03.786519 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f2bbda55-de30-4d80-be8a-14546df84e71 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:03.786948 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f2bbda55-de30-4d80-be8a-14546df84e71 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:03.870275 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-df9c625d-2152-4d44-a3b0-44deb05bcdc2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 204 len: 0 microversion: 2.1 time: 0.145960 Jul 27 04:29:03.871042 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 323/657] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:29:03 2022] DELETE /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:29:03.880383 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-875d0cca-e21a-4b95-8bd2-79f2c91deef2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:03.881083 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-875d0cca-e21a-4b95-8bd2-79f2c91deef2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:03.887586 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-875d0cca-e21a-4b95-8bd2-79f2c91deef2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:03.888034 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-875d0cca-e21a-4b95-8bd2-79f2c91deef2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:03.888833 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-875d0cca-e21a-4b95-8bd2-79f2c91deef2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:03.890490 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-875d0cca-e21a-4b95-8bd2-79f2c91deef2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:03.944111 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f2bbda55-de30-4d80-be8a-14546df84e71 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:03.953345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f2bbda55-de30-4d80-be8a-14546df84e71 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:03.955678 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f2bbda55-de30-4d80-be8a-14546df84e71 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:03.956850 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f2bbda55-de30-4d80-be8a-14546df84e71 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1721 microversion: 2.20 time: 0.183735 Jul 27 04:29:03.957774 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 335/658] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:29:03 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:29:04.043829 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-875d0cca-e21a-4b95-8bd2-79f2c91deef2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:04.052010 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-875d0cca-e21a-4b95-8bd2-79f2c91deef2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.175794 Jul 27 04:29:04.052585 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 324/659] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:03 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:04.980700 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1dc331fa-9bf1-4e6e-92b3-d43230c14bc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:04.981224 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-1dc331fa-9bf1-4e6e-92b3-d43230c14bc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:04.988526 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1dc331fa-9bf1-4e6e-92b3-d43230c14bc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:04.988972 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1dc331fa-9bf1-4e6e-92b3-d43230c14bc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:04.989735 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1dc331fa-9bf1-4e6e-92b3-d43230c14bc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:04.990208 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1dc331fa-9bf1-4e6e-92b3-d43230c14bc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:05.073142 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-13ef24fb-1a09-4fcc-b7b3-55c246b52d24 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:05.073903 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-13ef24fb-1a09-4fcc-b7b3-55c246b52d24 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:05.081038 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-13ef24fb-1a09-4fcc-b7b3-55c246b52d24 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:05.081519 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-13ef24fb-1a09-4fcc-b7b3-55c246b52d24 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:05.082322 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-13ef24fb-1a09-4fcc-b7b3-55c246b52d24 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:05.082758 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-13ef24fb-1a09-4fcc-b7b3-55c246b52d24 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:05.119603 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-1dc331fa-9bf1-4e6e-92b3-d43230c14bc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:05.128185 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-1dc331fa-9bf1-4e6e-92b3-d43230c14bc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:05.129737 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-1dc331fa-9bf1-4e6e-92b3-d43230c14bc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:05.130928 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-1dc331fa-9bf1-4e6e-92b3-d43230c14bc4 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1721 microversion: 2.20 time: 0.154233 Jul 27 04:29:05.131488 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 336/660] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:29:04 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:29:05.226591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-13ef24fb-1a09-4fcc-b7b3-55c246b52d24 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:05.234203 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-13ef24fb-1a09-4fcc-b7b3-55c246b52d24 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.165124 Jul 27 04:29:05.234703 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 325/661] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:05 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:29:06.157463 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1bb268e6-75c9-4ac2-a30b-316238d13227 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:06.158334 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-1bb268e6-75c9-4ac2-a30b-316238d13227 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:06.165091 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1bb268e6-75c9-4ac2-a30b-316238d13227 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:06.165546 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1bb268e6-75c9-4ac2-a30b-316238d13227 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:06.166350 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1bb268e6-75c9-4ac2-a30b-316238d13227 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:06.166782 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1bb268e6-75c9-4ac2-a30b-316238d13227 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:06.298601 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-1bb268e6-75c9-4ac2-a30b-316238d13227 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:06.306649 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-1bb268e6-75c9-4ac2-a30b-316238d13227 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:06.308182 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-1bb268e6-75c9-4ac2-a30b-316238d13227 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:06.309328 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-1bb268e6-75c9-4ac2-a30b-316238d13227 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1721 microversion: 2.20 time: 0.156255 Jul 27 04:29:06.309913 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 337/662] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:29:06 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:29:06.362310 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8c7ca620-cd67-4fab-a790-d67ef04348ff tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:06.363418 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8c7ca620-cd67-4fab-a790-d67ef04348ff tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:06.369835 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8c7ca620-cd67-4fab-a790-d67ef04348ff tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:06.370325 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8c7ca620-cd67-4fab-a790-d67ef04348ff tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:06.371098 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8c7ca620-cd67-4fab-a790-d67ef04348ff tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:06.371535 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8c7ca620-cd67-4fab-a790-d67ef04348ff tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:06.552098 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8c7ca620-cd67-4fab-a790-d67ef04348ff tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:06.560063 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8c7ca620-cd67-4fab-a790-d67ef04348ff tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1567 microversion: 2.1 time: 0.309438 Jul 27 04:29:06.560742 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 326/663] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:06 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1567 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:29:07.223999 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-94cc2f14-5bb6-434e-8857-45c3d46c6e32 req-0b3fb405-403d-4cab-9317-ffd3921a02b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5496cce3-6266-4650-84ba-9e01e99cbea6", "name": "network-vif-deleted", "tag": "69fb12ed-2ec4-4ba8-a2dd-7b56427bd104"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:07.236110 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-94cc2f14-5bb6-434e-8857-45c3d46c6e32 req-0b3fb405-403d-4cab-9317-ffd3921a02b6 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:07.236906 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-94cc2f14-5bb6-434e-8857-45c3d46c6e32 req-0b3fb405-403d-4cab-9317-ffd3921a02b6 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:07.252177 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-94cc2f14-5bb6-434e-8857-45c3d46c6e32 req-0b3fb405-403d-4cab-9317-ffd3921a02b6 service nova] Creating event network-vif-deleted:69fb12ed-2ec4-4ba8-a2dd-7b56427bd104 for instance 5496cce3-6266-4650-84ba-9e01e99cbea6 on hv-cinder-85098 Jul 27 04:29:07.257420 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-94cc2f14-5bb6-434e-8857-45c3d46c6e32 req-0b3fb405-403d-4cab-9317-ffd3921a02b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037092 Jul 27 04:29:07.258119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 338/664] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:07.332706 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d6c871c2-4bd8-4e73-a153-37a345fbe1c7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:07.333322 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d6c871c2-4bd8-4e73-a153-37a345fbe1c7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:07.339699 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d6c871c2-4bd8-4e73-a153-37a345fbe1c7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:07.340154 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d6c871c2-4bd8-4e73-a153-37a345fbe1c7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:07.340972 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d6c871c2-4bd8-4e73-a153-37a345fbe1c7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:07.341467 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d6c871c2-4bd8-4e73-a153-37a345fbe1c7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:07.404317 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d6c871c2-4bd8-4e73-a153-37a345fbe1c7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:07.412204 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d6c871c2-4bd8-4e73-a153-37a345fbe1c7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:07.413693 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d6c871c2-4bd8-4e73-a153-37a345fbe1c7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:07.414862 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d6c871c2-4bd8-4e73-a153-37a345fbe1c7 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1654 microversion: 2.20 time: 0.086071 Jul 27 04:29:07.415412 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 327/665] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:29:07 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1654 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:29:07.588058 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8872724c-08ff-4956-9b28-3214db91aec2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:07.589231 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-8872724c-08ff-4956-9b28-3214db91aec2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:07.604170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8872724c-08ff-4956-9b28-3214db91aec2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:07.609605 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8872724c-08ff-4956-9b28-3214db91aec2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:07.614922 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8872724c-08ff-4956-9b28-3214db91aec2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:07.615937 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8872724c-08ff-4956-9b28-3214db91aec2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:07.855895 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-8872724c-08ff-4956-9b28-3214db91aec2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7f399240ee4003b0e72fd34d96f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992437dfa6ef4c678ea5d4f92155cf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:07.864543 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8872724c-08ff-4956-9b28-3214db91aec2 tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 200 len: 1219 microversion: 2.1 time: 0.284937 Jul 27 04:29:07.865118 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 339/666] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:07 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 1219 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:08.438830 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2587ec2f-3eb0-44bc-995c-af1fc475a7c2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:08.439722 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2587ec2f-3eb0-44bc-995c-af1fc475a7c2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:08.447090 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2587ec2f-3eb0-44bc-995c-af1fc475a7c2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:08.447779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2587ec2f-3eb0-44bc-995c-af1fc475a7c2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:08.448623 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2587ec2f-3eb0-44bc-995c-af1fc475a7c2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:08.449068 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2587ec2f-3eb0-44bc-995c-af1fc475a7c2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:08.484398 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2587ec2f-3eb0-44bc-995c-af1fc475a7c2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:08.484852 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2587ec2f-3eb0-44bc-995c-af1fc475a7c2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:08.485310 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.objects.instance [None req-2587ec2f-3eb0-44bc-995c-af1fc475a7c2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lazy-loading 'fault' on Instance uuid ea65d581-c4a6-4764-93c8-5ca7b0fe08fa {{(pid=117739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:29:08.526321 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2587ec2f-3eb0-44bc-995c-af1fc475a7c2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:08.535506 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2587ec2f-3eb0-44bc-995c-af1fc475a7c2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:08.537138 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2587ec2f-3eb0-44bc-995c-af1fc475a7c2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eaa342a6bc84529a5d252c7a9a161ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243e75013f5f49e88df72564ac0d2fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:08.538341 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2587ec2f-3eb0-44bc-995c-af1fc475a7c2 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 200 len: 1370 microversion: 2.20 time: 0.104103 Jul 27 04:29:08.538894 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 328/667] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:29:08 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 04:29:08.886705 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3f8de73b-b865-48a1-bb22-d3ad7a1651fb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:08.887333 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3f8de73b-b865-48a1-bb22-d3ad7a1651fb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] [instance: 5496cce3-6266-4650-84ba-9e01e99cbea6] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:08.894417 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f8de73b-b865-48a1-bb22-d3ad7a1651fb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:08.894872 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f8de73b-b865-48a1-bb22-d3ad7a1651fb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:08.895638 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f8de73b-b865-48a1-bb22-d3ad7a1651fb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:08.896077 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f8de73b-b865-48a1-bb22-d3ad7a1651fb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:08.910213 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-3f8de73b-b865-48a1-bb22-d3ad7a1651fb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] HTTP exception thrown: Instance 5496cce3-6266-4650-84ba-9e01e99cbea6 could not be found. Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3f8de73b-b865-48a1-bb22-d3ad7a1651fb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Request method failure captured: Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 HTTP/1.1 Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L3cFDzpd5tBNsFWbA1apVc1vbnL-sdLJjr_l-T0v3iho2EtpyJGed11P4m9wodKNvhTxLLQsqOaLyCpIZlUGl19OS4fRll0GKIr1hqeekBZmTmtSLUd9T2L7JwAqdGpvEzxZsSe7lUZcpuZez4dkr7p_n0og-EmeNCzzPX3FtPwNKE Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 992437dfa6ef4c678ea5d4f92155cf17 Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-TestShelveInstance-1325158256 Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:29:08.911825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:29:08.913464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/992437dfa6ef4c678ea5d4f92155cf17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/992437dfa6ef4c678ea5d4f92155cf17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/992437dfa6ef4c678ea5d4f92155cf17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_992437dfa6ef4c678ea5d4f92155cf17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:29:08.913464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-TestShelveInstance-1325158256 Jul 27 04:29:08.913464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 992437dfa6ef4c678ea5d4f92155cf17 Jul 27 04:29:08.913464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-TestShelveInstance-1325158256 Jul 27 04:29:08.913464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-TestShelveInstance-1325158256-project Jul 27 04:29:08.913464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:29:08.913464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:29:08.913464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 5a7f399240ee4003b0e72fd34d96f47b Jul 27 04:29:08.913464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-TestShelveInstance-1325158256-project Jul 27 04:29:08.913464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:29:08.913464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 5496cce3-6266-4650-84ba-9e01e99cbea6 could not be found. Jul 27 04:29:08.913464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '5496cce3-6266-4650-84ba-9e01e99cbea6'} Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5496cce3-6266-4650-84ba-9e01e99cbea6 could not be found. Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:29:08.914534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5496cce3-6266-4650-84ba-9e01e99cbea6 could not be found. Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5496cce3-6266-4650-84ba-9e01e99cbea6 could not be found. Jul 27 04:29:08.915869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:08.916986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3f8de73b-b865-48a1-bb22-d3ad7a1651fb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Returning 404 to user: Instance 5496cce3-6266-4650-84ba-9e01e99cbea6 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:29:08.916986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3f8de73b-b865-48a1-bb22-d3ad7a1651fb tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6" status: 404 len: 111 microversion: 2.1 time: 0.030392 Jul 27 04:29:08.916986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 340/668] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:08 2022] GET /compute/v2.1/servers/5496cce3-6266-4650-84ba-9e01e99cbea6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:29:09.073346 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9b99560a-67d6-4a2b-9f8c-fe2c3f8f02de tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] Calling method '.version_select at 0x7f21d5b68ee0>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:09.098285 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9b99560a-67d6-4a2b-9f8c-fe2c3f8f02de tempest-TestShelveInstance-1325158256 tempest-TestShelveInstance-1325158256-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-436101483" status: 202 len: 0 microversion: 2.1 time: 0.028853 Jul 27 04:29:09.099433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 329/669] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Jul 27 04:29:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-436101483 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:29:09.276602 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-07fdb1bd-e1f3-4ae2-ae26-2b219e0385a6 req-32843fb0-96ff-42c3-ae19-6f7ea3f478b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea65d581-c4a6-4764-93c8-5ca7b0fe08fa", "name": "network-vif-deleted", "tag": "30ff67e2-9db2-4be1-97bd-8066d0658180"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:09.286058 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-07fdb1bd-e1f3-4ae2-ae26-2b219e0385a6 req-32843fb0-96ff-42c3-ae19-6f7ea3f478b8 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:09.286504 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-07fdb1bd-e1f3-4ae2-ae26-2b219e0385a6 req-32843fb0-96ff-42c3-ae19-6f7ea3f478b8 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:09.297122 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-07fdb1bd-e1f3-4ae2-ae26-2b219e0385a6 req-32843fb0-96ff-42c3-ae19-6f7ea3f478b8 service nova] Creating event network-vif-deleted:30ff67e2-9db2-4be1-97bd-8066d0658180 for instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa on hv-cinder-85098 Jul 27 04:29:09.301874 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-07fdb1bd-e1f3-4ae2-ae26-2b219e0385a6 req-32843fb0-96ff-42c3-ae19-6f7ea3f478b8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029034 Jul 27 04:29:09.302586 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 341/670] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:09.562015 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3247b7c4-1f79-48be-a194-825f2e58d251 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:09.562564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-3247b7c4-1f79-48be-a194-825f2e58d251 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:09.568930 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3247b7c4-1f79-48be-a194-825f2e58d251 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:09.569374 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3247b7c4-1f79-48be-a194-825f2e58d251 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:09.570195 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3247b7c4-1f79-48be-a194-825f2e58d251 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:09.570628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3247b7c4-1f79-48be-a194-825f2e58d251 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:09.583877 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-3247b7c4-1f79-48be-a194-825f2e58d251 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] HTTP exception thrown: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3247b7c4-1f79-48be-a194-825f2e58d251 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Request method failure captured: Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa HTTP/1.1 Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L22tU-MfLyltm-qEQwO0vWbGKtUxKRm9tAeZac2tHlreoab-rx5nclncfPbzo9ADYZQeKvX9imPi3uB6iOUc4a2As6lIZ7y1QKROohNpUNbO_7mLM_qmUMteiaWwljji0YGBU0miMCgxOt1GXRxBbLzOvuy1aJejEMKOuYVjH41Isg Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: 243e75013f5f49e88df72564ac0d2fe7 Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:29:09.585511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:29:09.587054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:29:09.587054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:09.587054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: 243e75013f5f49e88df72564ac0d2fe7 Jul 27 04:29:09.587054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:09.587054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-AttachVolumeShelveTestJSON-1869080554-project Jul 27 04:29:09.587054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:29:09.587054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:29:09.587054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 0eaa342a6bc84529a5d252c7a9a161ba Jul 27 04:29:09.587054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1869080554-project Jul 27 04:29:09.587054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:29:09.587054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:09.587054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': 'ea65d581-c4a6-4764-93c8-5ca7b0fe08fa'} Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:29:09.587958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:09.589550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:09.591099 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3247b7c4-1f79-48be-a194-825f2e58d251 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Returning 404 to user: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:29:09.591099 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-3247b7c4-1f79-48be-a194-825f2e58d251 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 404 len: 111 microversion: 2.20 time: 0.030099 Jul 27 04:29:09.591099 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 330/671] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:29:09 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 04:29:09.596214 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b0991568-a3f8-40ec-a1e6-3668125bf930 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '.version_select at 0x7f21d6608040>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:09.617506 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b0991568-a3f8-40ec-a1e6-3668125bf930 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-172792172" status: 204 len: 0 microversion: 2.20 time: 0.025360 Jul 27 04:29:09.618114 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 342/672] 10.222.0.46 () {60 vars in 1259 bytes} [Wed Jul 27 04:29:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-172792172 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 27 04:29:11.374134 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2bea2001-9b92-41c6-b453-d55227359074 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:11.374617 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2bea2001-9b92-41c6-b453-d55227359074 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:11.380959 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2bea2001-9b92-41c6-b453-d55227359074 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:11.381399 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2bea2001-9b92-41c6-b453-d55227359074 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:11.382186 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2bea2001-9b92-41c6-b453-d55227359074 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:11.382615 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2bea2001-9b92-41c6-b453-d55227359074 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:11.410331 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2bea2001-9b92-41c6-b453-d55227359074 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd/ips" status: 200 len: 150 microversion: 2.1 time: 0.040770 Jul 27 04:29:11.411254 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 331/673] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Jul 27 04:29:11 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:11.424987 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b6ff1da3-0916-4b47-9a00-9325c7c6ba7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dff9516a-25fe-49c2-8f3f-aa68031ddd4a"}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:11.427742 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b6ff1da3-0916-4b47-9a00-9325c7c6ba7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:11.435321 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b6ff1da3-0916-4b47-9a00-9325c7c6ba7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:11.436211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b6ff1da3-0916-4b47-9a00-9325c7c6ba7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:11.437304 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b6ff1da3-0916-4b47-9a00-9325c7c6ba7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:11.437791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b6ff1da3-0916-4b47-9a00-9325c7c6ba7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:11.537402 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-b6ff1da3-0916-4b47-9a00-9325c7c6ba7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Invalid volume: volume dff9516a-25fe-49c2-8f3f-aa68031ddd4a is already attached to instances: 6df1d9b6-b48f-46d2-876e-dd6d14f70285 Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b6ff1da3-0916-4b47-9a00-9325c7c6ba7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: POST /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd/os-volume_attachments HTTP/1.1 Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 74 Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:29:11.539384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:29:11.540738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:29:11.540738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:29:11.540738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:29:11.540738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:29:11.540738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:29:11.540738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:29:11.540738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:29:11.540738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:29:11.540738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:29:11.540738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Jul 27 04:29:11.540738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {"volumeAttachment": {"volumeId": "dff9516a-25fe-49c2-8f3f-aa68031ddd4a"}} Jul 27 04:29:11.540738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Invalid volume: volume dff9516a-25fe-49c2-8f3f-aa68031ddd4a is already attached to instances: 6df1d9b6-b48f-46d2-876e-dd6d14f70285 Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'server_id': '8efc620d-10a0-4def-b781-58225aaad7dd', 'body': {'volumeAttachment': {'volumeId': 'dff9516a-25fe-49c2-8f3f-aa68031ddd4a'}}} Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dff9516a-25fe-49c2-8f3f-aa68031ddd4a is already attached to instances: 6df1d9b6-b48f-46d2-876e-dd6d14f70285 Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.541507 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dff9516a-25fe-49c2-8f3f-aa68031ddd4a is already attached to instances: 6df1d9b6-b48f-46d2-876e-dd6d14f70285 Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:11.543211 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:11.545706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:11.545706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:29:11.545706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:29:11.545706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dff9516a-25fe-49c2-8f3f-aa68031ddd4a is already attached to instances: 6df1d9b6-b48f-46d2-876e-dd6d14f70285 Jul 27 04:29:11.545706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.545706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b6ff1da3-0916-4b47-9a00-9325c7c6ba7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 400 to user: Invalid volume: volume dff9516a-25fe-49c2-8f3f-aa68031ddd4a is already attached to instances: 6df1d9b6-b48f-46d2-876e-dd6d14f70285 {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:29:11.545706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b6ff1da3-0916-4b47-9a00-9325c7c6ba7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "POST /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121335 Jul 27 04:29:11.545706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 343/674] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:29:11 2022] POST /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 04:29:11.551402 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-861a7cab-9c86-47a2-81af-d0a9bf1cf109 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:11.551897 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-861a7cab-9c86-47a2-81af-d0a9bf1cf109 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:11.558709 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-861a7cab-9c86-47a2-81af-d0a9bf1cf109 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:11.559422 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-861a7cab-9c86-47a2-81af-d0a9bf1cf109 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:11.560389 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-861a7cab-9c86-47a2-81af-d0a9bf1cf109 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:11.561209 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-861a7cab-9c86-47a2-81af-d0a9bf1cf109 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:11.592835 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-861a7cab-9c86-47a2-81af-d0a9bf1cf109 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Going to try to terminate instance {{(pid=117739) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:29:11.675010 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-506c2cea-8ca8-44a5-b982-33b8edc8e72f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:11.675540 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-506c2cea-8ca8-44a5-b982-33b8edc8e72f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:11.692547 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-506c2cea-8ca8-44a5-b982-33b8edc8e72f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:11.693311 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-506c2cea-8ca8-44a5-b982-33b8edc8e72f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:11.694360 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-506c2cea-8ca8-44a5-b982-33b8edc8e72f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:11.695023 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-506c2cea-8ca8-44a5-b982-33b8edc8e72f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:11.712571 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-861a7cab-9c86-47a2-81af-d0a9bf1cf109 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 204 len: 0 microversion: 2.1 time: 0.163359 Jul 27 04:29:11.713711 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 332/675] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:29:11 2022] DELETE /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:29:11.722231 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-506c2cea-8ca8-44a5-b982-33b8edc8e72f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] HTTP exception thrown: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-506c2cea-8ca8-44a5-b982-33b8edc8e72f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Request method failure captured: Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: DELETE /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa HTTP/1.1 Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L22tU-MfLyltm-qEQwO0vWbGKtUxKRm9tAeZac2tHlreoab-rx5nclncfPbzo9ADYZQeKvX9imPi3uB6iOUc4a2As6lIZ7y1QKROohNpUNbO_7mLM_qmUMteiaWwljji0YGBU0miMCgxOt1GXRxBbLzOvuy1aJejEMKOuYVjH41Isg Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 243e75013f5f49e88df72564ac0d2fe7 Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:29:11.724170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:29:11.725582 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:29:11.725582 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:11.725582 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 243e75013f5f49e88df72564ac0d2fe7 Jul 27 04:29:11.725582 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:11.725582 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeShelveTestJSON-1869080554-project Jul 27 04:29:11.725582 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:29:11.725582 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:29:11.725582 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 0eaa342a6bc84529a5d252c7a9a161ba Jul 27 04:29:11.725582 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1869080554-project Jul 27 04:29:11.725582 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:29:11.725582 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:11.725582 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': 'ea65d581-c4a6-4764-93c8-5ca7b0fe08fa'} Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:29:11.726325 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:11.727921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.731369 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-506c2cea-8ca8-44a5-b982-33b8edc8e72f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Returning 404 to user: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:29:11.732316 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-506c2cea-8ca8-44a5-b982-33b8edc8e72f tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 404 len: 111 microversion: 2.20 time: 0.061656 Jul 27 04:29:11.733589 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f6cde67d-b049-45c3-8235-db7d0c1b34e5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:11.734041 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 344/676] 10.222.0.46 () {60 vars in 1280 bytes} [Wed Jul 27 04:29:11 2022] DELETE /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 04:29:11.742088 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f6cde67d-b049-45c3-8235-db7d0c1b34e5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:11.744964 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-20cf06bd-c9d9-44f0-9a5c-cc496799d46b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:11.745833 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-20cf06bd-c9d9-44f0-9a5c-cc496799d46b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: ea65d581-c4a6-4764-93c8-5ca7b0fe08fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:11.757199 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f6cde67d-b049-45c3-8235-db7d0c1b34e5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:11.757422 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-20cf06bd-c9d9-44f0-9a5c-cc496799d46b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:11.757651 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f6cde67d-b049-45c3-8235-db7d0c1b34e5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:11.758696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f6cde67d-b049-45c3-8235-db7d0c1b34e5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:11.759188 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f6cde67d-b049-45c3-8235-db7d0c1b34e5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:11.759661 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-20cf06bd-c9d9-44f0-9a5c-cc496799d46b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:11.760802 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-20cf06bd-c9d9-44f0-9a5c-cc496799d46b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:11.761244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-20cf06bd-c9d9-44f0-9a5c-cc496799d46b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:11.786071 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-20cf06bd-c9d9-44f0-9a5c-cc496799d46b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] HTTP exception thrown: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-20cf06bd-c9d9-44f0-9a5c-cc496799d46b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Request method failure captured: Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa HTTP/1.1 Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L22tU-MfLyltm-qEQwO0vWbGKtUxKRm9tAeZac2tHlreoab-rx5nclncfPbzo9ADYZQeKvX9imPi3uB6iOUc4a2As6lIZ7y1QKROohNpUNbO_7mLM_qmUMteiaWwljji0YGBU0miMCgxOt1GXRxBbLzOvuy1aJejEMKOuYVjH41Isg Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 243e75013f5f49e88df72564ac0d2fe7 Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:29:11.787993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:29:11.789344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:29:11.789344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:11.789344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 243e75013f5f49e88df72564ac0d2fe7 Jul 27 04:29:11.789344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:11.789344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeShelveTestJSON-1869080554-project Jul 27 04:29:11.789344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:29:11.789344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:29:11.789344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 0eaa342a6bc84529a5d252c7a9a161ba Jul 27 04:29:11.789344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1869080554-project Jul 27 04:29:11.789344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:29:11.789344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:11.789344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': 'ea65d581-c4a6-4764-93c8-5ca7b0fe08fa'} Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:29:11.790084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. Jul 27 04:29:11.791244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:11.792323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-20cf06bd-c9d9-44f0-9a5c-cc496799d46b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Returning 404 to user: Instance ea65d581-c4a6-4764-93c8-5ca7b0fe08fa could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:29:11.792323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-20cf06bd-c9d9-44f0-9a5c-cc496799d46b tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa" status: 404 len: 111 microversion: 2.20 time: 0.051374 Jul 27 04:29:11.793525 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 345/677] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:29:11 2022] GET /compute/v2.1/servers/ea65d581-c4a6-4764-93c8-5ca7b0fe08fa => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 04:29:12.033650 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f6cde67d-b049-45c3-8235-db7d0c1b34e5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:12.042333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f6cde67d-b049-45c3-8235-db7d0c1b34e5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1682 microversion: 2.1 time: 0.323310 Jul 27 04:29:12.043181 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 333/678] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:11 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1682 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:12.979739 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d932b84e-dfef-49ee-b8c6-78afb0bffc06 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:12.980479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d932b84e-dfef-49ee-b8c6-78afb0bffc06 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:12.987688 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d932b84e-dfef-49ee-b8c6-78afb0bffc06 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:12.988140 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d932b84e-dfef-49ee-b8c6-78afb0bffc06 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:12.988915 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d932b84e-dfef-49ee-b8c6-78afb0bffc06 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:12.989359 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d932b84e-dfef-49ee-b8c6-78afb0bffc06 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:13.003140 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-d932b84e-dfef-49ee-b8c6-78afb0bffc06 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] HTTP exception thrown: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d932b84e-dfef-49ee-b8c6-78afb0bffc06 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Request method failure captured: Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: DELETE /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe HTTP/1.1 Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L22tU-MfLyltm-qEQwO0vWbGKtUxKRm9tAeZac2tHlreoab-rx5nclncfPbzo9ADYZQeKvX9imPi3uB6iOUc4a2As6lIZ7y1QKROohNpUNbO_7mLM_qmUMteiaWwljji0YGBU0miMCgxOt1GXRxBbLzOvuy1aJejEMKOuYVjH41Isg Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 243e75013f5f49e88df72564ac0d2fe7 Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:29:13.004686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:29:13.006373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:29:13.006373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:13.006373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 243e75013f5f49e88df72564ac0d2fe7 Jul 27 04:29:13.006373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:13.006373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeShelveTestJSON-1869080554-project Jul 27 04:29:13.006373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:29:13.006373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:29:13.006373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 0eaa342a6bc84529a5d252c7a9a161ba Jul 27 04:29:13.006373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1869080554-project Jul 27 04:29:13.006373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:29:13.006373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:29:13.006373 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '9478c2cb-a66c-4485-91bf-fe8486025afe'} Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:29:13.007174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:29:13.009119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:13.010333 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d932b84e-dfef-49ee-b8c6-78afb0bffc06 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Returning 404 to user: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:29:13.010333 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d932b84e-dfef-49ee-b8c6-78afb0bffc06 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 404 len: 111 microversion: 2.20 time: 0.030268 Jul 27 04:29:13.010333 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 346/679] 10.222.0.46 () {60 vars in 1280 bytes} [Wed Jul 27 04:29:12 2022] DELETE /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 04:29:13.014898 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-eaea46b2-6db6-45d5-9b13-075319458d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:13.015821 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-eaea46b2-6db6-45d5-9b13-075319458d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] [instance: 9478c2cb-a66c-4485-91bf-fe8486025afe] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:13.022307 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-eaea46b2-6db6-45d5-9b13-075319458d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:13.022758 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-eaea46b2-6db6-45d5-9b13-075319458d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:13.023522 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-eaea46b2-6db6-45d5-9b13-075319458d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:13.023955 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-eaea46b2-6db6-45d5-9b13-075319458d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:13.037757 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-eaea46b2-6db6-45d5-9b13-075319458d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] HTTP exception thrown: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-eaea46b2-6db6-45d5-9b13-075319458d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Request method failure captured: Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe HTTP/1.1 Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L22tU-MfLyltm-qEQwO0vWbGKtUxKRm9tAeZac2tHlreoab-rx5nclncfPbzo9ADYZQeKvX9imPi3uB6iOUc4a2As6lIZ7y1QKROohNpUNbO_7mLM_qmUMteiaWwljji0YGBU0miMCgxOt1GXRxBbLzOvuy1aJejEMKOuYVjH41Isg Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: 243e75013f5f49e88df72564ac0d2fe7 Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:29:13.039427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:29:13.040855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_243e75013f5f49e88df72564ac0d2fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:29:13.040855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:13.040855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: 243e75013f5f49e88df72564ac0d2fe7 Jul 27 04:29:13.040855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1869080554 Jul 27 04:29:13.040855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-AttachVolumeShelveTestJSON-1869080554-project Jul 27 04:29:13.040855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:29:13.040855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:29:13.040855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 0eaa342a6bc84529a5d252c7a9a161ba Jul 27 04:29:13.040855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1869080554-project Jul 27 04:29:13.040855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:29:13.040855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:29:13.040855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '9478c2cb-a66c-4485-91bf-fe8486025afe'} Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:29:13.041578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. Jul 27 04:29:13.042822 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:13.043883 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-eaea46b2-6db6-45d5-9b13-075319458d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] Returning 404 to user: Instance 9478c2cb-a66c-4485-91bf-fe8486025afe could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:29:13.043883 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-eaea46b2-6db6-45d5-9b13-075319458d83 tempest-AttachVolumeShelveTestJSON-1869080554 tempest-AttachVolumeShelveTestJSON-1869080554-project] 10.222.0.46 "GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe" status: 404 len: 111 microversion: 2.20 time: 0.030088 Jul 27 04:29:13.043883 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 334/680] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jul 27 04:29:13 2022] GET /compute/v2.1/servers/9478c2cb-a66c-4485-91bf-fe8486025afe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 04:29:13.065733 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b222cfda-19cd-484f-a109-25df112d9fe2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:13.066858 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b222cfda-19cd-484f-a109-25df112d9fe2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:13.074725 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b222cfda-19cd-484f-a109-25df112d9fe2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:13.075181 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b222cfda-19cd-484f-a109-25df112d9fe2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:13.076372 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b222cfda-19cd-484f-a109-25df112d9fe2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:13.076825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b222cfda-19cd-484f-a109-25df112d9fe2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:13.688464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b222cfda-19cd-484f-a109-25df112d9fe2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:13.696483 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b222cfda-19cd-484f-a109-25df112d9fe2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1682 microversion: 2.1 time: 0.635094 Jul 27 04:29:13.697622 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 347/681] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:13 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1682 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:14.720272 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-de7f2e08-b31a-4779-a690-c8f70eabfaf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:14.721435 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-de7f2e08-b31a-4779-a690-c8f70eabfaf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:14.734455 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-de7f2e08-b31a-4779-a690-c8f70eabfaf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:14.735277 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-de7f2e08-b31a-4779-a690-c8f70eabfaf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:14.738695 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-de7f2e08-b31a-4779-a690-c8f70eabfaf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:14.739477 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-de7f2e08-b31a-4779-a690-c8f70eabfaf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:14.895880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-c5f5cb59-039f-4862-bee5-bb759be04fc9 req-e91ba173-c759-4d4e-ae79-fd5674ee88cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8efc620d-10a0-4def-b781-58225aaad7dd", "name": "network-vif-deleted", "tag": "a797c33e-381b-4d81-ab52-f6fc5fa377b5"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:14.911463 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-c5f5cb59-039f-4862-bee5-bb759be04fc9 req-e91ba173-c759-4d4e-ae79-fd5674ee88cc service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:14.918898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-c5f5cb59-039f-4862-bee5-bb759be04fc9 req-e91ba173-c759-4d4e-ae79-fd5674ee88cc service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:14.948674 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-c5f5cb59-039f-4862-bee5-bb759be04fc9 req-e91ba173-c759-4d4e-ae79-fd5674ee88cc service nova] Creating event network-vif-deleted:a797c33e-381b-4d81-ab52-f6fc5fa377b5 for instance 8efc620d-10a0-4def-b781-58225aaad7dd on hv-cinder-85098 Jul 27 04:29:14.954310 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-c5f5cb59-039f-4862-bee5-bb759be04fc9 req-e91ba173-c759-4d4e-ae79-fd5674ee88cc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064246 Jul 27 04:29:14.955760 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 348/682] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:14.962455 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-de7f2e08-b31a-4779-a690-c8f70eabfaf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:14.989081 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-de7f2e08-b31a-4779-a690-c8f70eabfaf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 200 len: 1614 microversion: 2.1 time: 0.270173 Jul 27 04:29:14.990430 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 335/683] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:14 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 1614 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:29:16.012653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4d94f09e-2abc-49e1-a878-774fea9c1019 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:16.013455 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4d94f09e-2abc-49e1-a878-774fea9c1019 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:16.027220 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d94f09e-2abc-49e1-a878-774fea9c1019 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:16.027766 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d94f09e-2abc-49e1-a878-774fea9c1019 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:16.028690 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d94f09e-2abc-49e1-a878-774fea9c1019 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:16.029914 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d94f09e-2abc-49e1-a878-774fea9c1019 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:16.060629 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-4d94f09e-2abc-49e1-a878-774fea9c1019 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4d94f09e-2abc-49e1-a878-774fea9c1019 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd HTTP/1.1 Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:29:16.066312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:29:16.067904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:29:16.067904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:29:16.067904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:29:16.067904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:29:16.067904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:29:16.067904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:29:16.067904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:29:16.067904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:29:16.067904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:29:16.067904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:29:16.067904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:29:16.067904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '8efc620d-10a0-4def-b781-58225aaad7dd'} Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:29:16.068994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:29:16.070458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:29:16.071749 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4d94f09e-2abc-49e1-a878-774fea9c1019 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 404 to user: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:29:16.071749 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4d94f09e-2abc-49e1-a878-774fea9c1019 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 404 len: 111 microversion: 2.1 time: 0.062640 Jul 27 04:29:16.076243 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 349/684] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:16 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:29:16.080259 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-cbf4b405-5113-427f-818c-401ffa5ec3a5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '.version_select at 0x7f21d5b4b940>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:16.117517 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-cbf4b405-5113-427f-818c-401ffa5ec3a5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-990508937" status: 202 len: 0 microversion: 2.1 time: 0.041253 Jul 27 04:29:16.119183 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 336/685] 10.222.0.46 () {58 vars in 1218 bytes} [Wed Jul 27 04:29:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-990508937 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 04:29:17.482080 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-71beaa92-8ac8-4470-9cd1-f6b0bbc38398 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:17.483210 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-71beaa92-8ac8-4470-9cd1-f6b0bbc38398 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:17.489549 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-71beaa92-8ac8-4470-9cd1-f6b0bbc38398 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:17.490006 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-71beaa92-8ac8-4470-9cd1-f6b0bbc38398 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:17.490773 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-71beaa92-8ac8-4470-9cd1-f6b0bbc38398 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:17.491201 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-71beaa92-8ac8-4470-9cd1-f6b0bbc38398 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:17.580277 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-71beaa92-8ac8-4470-9cd1-f6b0bbc38398 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lazy-loading 'services' on Instance uuid 6df1d9b6-b48f-46d2-876e-dd6d14f70285 {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:29:17.687605 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-71beaa92-8ac8-4470-9cd1-f6b0bbc38398 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285/os-volume_attachments/dff9516a-25fe-49c2-8f3f-aa68031ddd4a" status: 202 len: 0 microversion: 2.1 time: 0.209157 Jul 27 04:29:17.689166 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 350/686] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Jul 27 04:29:17 2022] DELETE /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285/os-volume_attachments/dff9516a-25fe-49c2-8f3f-aa68031ddd4a => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:29:17.700081 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e55031a3-17c2-46d9-9571-a363274671b5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:17.703185 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e55031a3-17c2-46d9-9571-a363274671b5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:17.710756 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e55031a3-17c2-46d9-9571-a363274671b5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:17.711667 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e55031a3-17c2-46d9-9571-a363274671b5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:17.712670 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e55031a3-17c2-46d9-9571-a363274671b5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:17.713704 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e55031a3-17c2-46d9-9571-a363274671b5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:17.764814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e55031a3-17c2-46d9-9571-a363274671b5 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068695 Jul 27 04:29:17.769677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 337/687] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:29:17 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:18.778563 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d69e1a53-ebf2-4cff-86f2-49177d12f361 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:18.781824 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d69e1a53-ebf2-4cff-86f2-49177d12f361 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:18.789154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d69e1a53-ebf2-4cff-86f2-49177d12f361 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:18.789532 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d69e1a53-ebf2-4cff-86f2-49177d12f361 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:18.790336 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d69e1a53-ebf2-4cff-86f2-49177d12f361 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:18.790931 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d69e1a53-ebf2-4cff-86f2-49177d12f361 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:18.823264 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d69e1a53-ebf2-4cff-86f2-49177d12f361 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049599 Jul 27 04:29:18.830030 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 351/688] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:29:18 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 04:29:18.895192 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-bd427532-b7d5-418d-be8e-a0f298151aa2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:18.895726 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-bd427532-b7d5-418d-be8e-a0f298151aa2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:18.902499 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bd427532-b7d5-418d-be8e-a0f298151aa2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:18.902939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bd427532-b7d5-418d-be8e-a0f298151aa2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:18.903917 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bd427532-b7d5-418d-be8e-a0f298151aa2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:18.905221 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bd427532-b7d5-418d-be8e-a0f298151aa2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:18.924010 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:18.931768 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-bd427532-b7d5-418d-be8e-a0f298151aa2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Going to try to terminate instance {{(pid=117739) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:29:19.022894 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-bd427532-b7d5-418d-be8e-a0f298151aa2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 204 len: 0 microversion: 2.1 time: 0.131369 Jul 27 04:29:19.024006 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 338/689] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:29:18 2022] DELETE /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:29:19.033070 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-44655703-0e68-433d-8e8f-6f605f3f23d2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:19.033800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-44655703-0e68-433d-8e8f-6f605f3f23d2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:19.039713 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-44655703-0e68-433d-8e8f-6f605f3f23d2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:19.040140 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-44655703-0e68-433d-8e8f-6f605f3f23d2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:19.040899 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-44655703-0e68-433d-8e8f-6f605f3f23d2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:19.041328 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-44655703-0e68-433d-8e8f-6f605f3f23d2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:19.183738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-44655703-0e68-433d-8e8f-6f605f3f23d2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:19.192756 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-44655703-0e68-433d-8e8f-6f605f3f23d2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1680 microversion: 2.1 time: 0.164264 Jul 27 04:29:19.193511 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 352/690] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:19 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:20.215622 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-24ae2024-4540-4ead-b9bc-38db510e93a7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:20.216172 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-24ae2024-4540-4ead-b9bc-38db510e93a7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:20.224428 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-24ae2024-4540-4ead-b9bc-38db510e93a7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:20.224801 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-24ae2024-4540-4ead-b9bc-38db510e93a7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:20.225505 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-24ae2024-4540-4ead-b9bc-38db510e93a7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:20.225963 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-24ae2024-4540-4ead-b9bc-38db510e93a7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:20.386549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-24ae2024-4540-4ead-b9bc-38db510e93a7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:20.394826 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-24ae2024-4540-4ead-b9bc-38db510e93a7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1680 microversion: 2.1 time: 0.183507 Jul 27 04:29:20.395399 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 339/691] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:20 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:21.418477 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-28a85829-ad38-49b7-93df-29861bf4b2bd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:21.419249 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-28a85829-ad38-49b7-93df-29861bf4b2bd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:21.427512 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28a85829-ad38-49b7-93df-29861bf4b2bd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:21.428073 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28a85829-ad38-49b7-93df-29861bf4b2bd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:21.428876 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28a85829-ad38-49b7-93df-29861bf4b2bd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:21.429310 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28a85829-ad38-49b7-93df-29861bf4b2bd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:21.523574 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-28a85829-ad38-49b7-93df-29861bf4b2bd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:21.532327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-28a85829-ad38-49b7-93df-29861bf4b2bd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1613 microversion: 2.1 time: 0.119997 Jul 27 04:29:21.533221 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 353/692] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:21 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1613 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:22.346661 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-17c473c5-98e4-4eae-88cc-e0ca0133d6fa req-050de3e2-1070-4630-b712-8784c989453d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df1d9b6-b48f-46d2-876e-dd6d14f70285", "name": "network-vif-deleted", "tag": "86c730dd-d6d3-4a99-8960-7e754ffd99e8"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:22.362375 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-17c473c5-98e4-4eae-88cc-e0ca0133d6fa req-050de3e2-1070-4630-b712-8784c989453d service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:22.363063 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-17c473c5-98e4-4eae-88cc-e0ca0133d6fa req-050de3e2-1070-4630-b712-8784c989453d service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:22.378314 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-17c473c5-98e4-4eae-88cc-e0ca0133d6fa req-050de3e2-1070-4630-b712-8784c989453d service nova] Creating event network-vif-deleted:86c730dd-d6d3-4a99-8960-7e754ffd99e8 for instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 on hv-cinder-85098 Jul 27 04:29:22.383930 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-17c473c5-98e4-4eae-88cc-e0ca0133d6fa req-050de3e2-1070-4630-b712-8784c989453d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044232 Jul 27 04:29:22.385223 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 340/693] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:22.553551 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-bc5a8c2b-3289-4cc7-836c-5044f17a18af tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:22.554193 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-bc5a8c2b-3289-4cc7-836c-5044f17a18af tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:22.561894 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc5a8c2b-3289-4cc7-836c-5044f17a18af tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:22.562369 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc5a8c2b-3289-4cc7-836c-5044f17a18af tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:22.563529 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc5a8c2b-3289-4cc7-836c-5044f17a18af tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:22.563971 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc5a8c2b-3289-4cc7-836c-5044f17a18af tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:22.568564 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:22.599279 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc5a8c2b-3289-4cc7-836c-5044f17a18af tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:22.599730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bc5a8c2b-3289-4cc7-836c-5044f17a18af tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:22.600254 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-bc5a8c2b-3289-4cc7-836c-5044f17a18af tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lazy-loading 'fault' on Instance uuid 6df1d9b6-b48f-46d2-876e-dd6d14f70285 {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:29:22.676104 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-bc5a8c2b-3289-4cc7-836c-5044f17a18af tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:22.683750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-bc5a8c2b-3289-4cc7-836c-5044f17a18af tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 200 len: 1331 microversion: 2.1 time: 0.134121 Jul 27 04:29:22.684679 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 354/694] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:22 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 1331 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:23.707426 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7353014f-4915-4c13-a9e5-3b846504d9c0 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:23.708904 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-7353014f-4915-4c13-a9e5-3b846504d9c0 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:23.720230 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7353014f-4915-4c13-a9e5-3b846504d9c0 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:23.721044 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7353014f-4915-4c13-a9e5-3b846504d9c0 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:23.722227 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7353014f-4915-4c13-a9e5-3b846504d9c0 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:23.724126 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7353014f-4915-4c13-a9e5-3b846504d9c0 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:23.744867 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-7353014f-4915-4c13-a9e5-3b846504d9c0 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7353014f-4915-4c13-a9e5-3b846504d9c0 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 HTTP/1.1 Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:29:23.747210 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:29:23.748614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:29:23.748614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:29:23.748614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:29:23.748614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:29:23.748614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:29:23.748614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:29:23.748614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:29:23.748614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:29:23.748614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:29:23.748614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:29:23.748614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:29:23.748614 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '6df1d9b6-b48f-46d2-876e-dd6d14f70285'} Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:29:23.749473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:29:23.750750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:29:23.753705 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7353014f-4915-4c13-a9e5-3b846504d9c0 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 404 to user: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:29:23.755155 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-7353014f-4915-4c13-a9e5-3b846504d9c0 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 404 len: 111 microversion: 2.1 time: 0.052825 Jul 27 04:29:23.765545 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-508c824c-ff46-461d-ae86-650749ffad53 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '.version_select at 0x7f21d5a7a0d0>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:23.770249 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 341/695] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:23 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:29:23.791434 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-508c824c-ff46-461d-ae86-650749ffad53 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-942173467" status: 202 len: 0 microversion: 2.1 time: 0.030307 Jul 27 04:29:23.792462 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 355/696] 10.222.0.46 () {58 vars in 1218 bytes} [Wed Jul 27 04:29:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-942173467 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:29:25.168205 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-375ef6ab-f9be-4a80-b698-0d695b4722e9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Action: 'create', calling method: .version_select at 0x7f21d5abb9d0>, body: {"keypair": {"name": "tempest-keypair-1241339738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfmfQ8UrZWNlg4AGJYFudw0bA7exizmt/wBUSdBBFSp2ZEmJS6esm+xHstroG+mOyBhH8sP5u8muUU75ek+c5sizXGyHeXMO1cM88I4wwWd8/ZPOJtudGUQXaRpm8mY9Q=="}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:25.186194 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-375ef6ab-f9be-4a80-b698-0d695b4722e9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for project aa51c6088dfa44df848e339d61bac664. Resources: {'key_pairs'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:29:25.190942 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-375ef6ab-f9be-4a80-b698-0d695b4722e9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for user 8cbc27f4433e4c48a75b216540a9022f and project aa51c6088dfa44df848e339d61bac664. Resources: {'key_pairs'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:29:25.215538 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-375ef6ab-f9be-4a80-b698-0d695b4722e9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051112 Jul 27 04:29:25.216124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 342/697] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Jul 27 04:29:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:25.436885 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a9d6d0ea-29a6-480c-ac31-a210479f5810 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Action: 'create', calling method: .version_select at 0x7f21d5ab5e50>, body: {"keypair": {"name": "tempest-keypair-550567146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcgtmZbpTD9KXvSdeTFp/S+8KLqC712Lta8Q5cpB+SWXGCYsLaGdr0ALx7u2DKqi2hHJz76AEv1B3p2rOGX8dKSPpP6GKYPSyB7kHGmkMIdX6uInGcjv76JTExceNPbag=="}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:25.456830 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-a9d6d0ea-29a6-480c-ac31-a210479f5810 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Getting quotas for project e51f9e52588e4008adf20f443c367b02. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:29:25.462289 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-a9d6d0ea-29a6-480c-ac31-a210479f5810 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Getting quotas for user 89aa18ddc71c4951bf15fcbd404912e9 and project e51f9e52588e4008adf20f443c367b02. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:29:25.487052 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a9d6d0ea-29a6-480c-ac31-a210479f5810 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.188617 Jul 27 04:29:25.498647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 356/698] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Jul 27 04:29:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:26.820580 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-326504240", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7941c677-84e1-4370-9083-08b3d22ae50b"}], "security_groups": [{"name": "tempest-securitygroup--507533984"}], "key_name": "tempest-keypair-1241339738", "user_data": "}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:26.982937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] validate_networks() for [('7941c677-84e1-4370-9083-08b3d22ae50b', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:29:27.116047 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-533936184", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5197559e-44b6-4dfe-9129-b0dbe7bd10f1"}], "security_groups": [{"name": "tempest-securitygroup--466891732"}], "key_name": "tempest-keypair-550567146", "user_data": "}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:27.229914 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.network.neutron [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] validate_networks() for [('5197559e-44b6-4dfe-9129-b0dbe7bd10f1', None, None, None, None, None)] {{(pid=117740) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:29:27.411652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:29:27.413059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:29:27.413808 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:29:27.415037 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:29:27.415664 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:29:27.437738 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:27.438219 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:27.439262 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:27.439705 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:27.457808 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for project aa51c6088dfa44df848e339d61bac664. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:29:27.464284 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for user 8cbc27f4433e4c48a75b216540a9022f and project aa51c6088dfa44df848e339d61bac664. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:29:27.485771 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:29:27.488500 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:29:27.558645 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c37dd4c7-3a93-4f90-af1d-a441adc8494a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.742187 Jul 27 04:29:27.559645 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 343/699] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:29:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:29:27.572432 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-dab666fd-398f-4fcb-aef1-96c7662410cb tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:27.573245 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-dab666fd-398f-4fcb-aef1-96c7662410cb tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:27.649803 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-dab666fd-398f-4fcb-aef1-96c7662410cb tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:27.659390 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-dab666fd-398f-4fcb-aef1-96c7662410cb tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1241 microversion: 2.1 time: 0.092146 Jul 27 04:29:27.671137 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 344/700] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:27 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:27.721519 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Flavor limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:29:27.722621 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Image limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:29:27.723798 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Flavor pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:29:27.724231 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Image pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:29:27.724705 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:29:27.738283 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:27.738735 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:27.739562 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:27.740238 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:27.762420 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Getting quotas for project e51f9e52588e4008adf20f443c367b02. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:29:27.767667 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Getting quotas for user 89aa18ddc71c4951bf15fcbd404912e9 and project e51f9e52588e4008adf20f443c367b02. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:29:27.779664 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Going to run 1 instances... {{(pid=117740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:29:27.781994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:29:27.844198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f543124f-4702-47a1-9cfd-707e61f57bc4 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.732763 Jul 27 04:29:27.844860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 357/701] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:29:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 04:29:27.856886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c1013ae9-94eb-4a90-983a-5764d07fb14c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:27.858834 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c1013ae9-94eb-4a90-983a-5764d07fb14c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:27.876997 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:27.999523 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c1013ae9-94eb-4a90-983a-5764d07fb14c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:28.009701 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c1013ae9-94eb-4a90-983a-5764d07fb14c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1236 microversion: 2.1 time: 0.157429 Jul 27 04:29:28.010729 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 345/702] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:27 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1236 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:29:28.682005 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-faa795a7-bc3e-4277-bfa5-7ba521621c78 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:28.682600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-faa795a7-bc3e-4277-bfa5-7ba521621c78 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:28.691683 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-faa795a7-bc3e-4277-bfa5-7ba521621c78 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:28.692372 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-faa795a7-bc3e-4277-bfa5-7ba521621c78 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:28.693166 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-faa795a7-bc3e-4277-bfa5-7ba521621c78 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:28.693709 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-faa795a7-bc3e-4277-bfa5-7ba521621c78 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:28.810167 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-faa795a7-bc3e-4277-bfa5-7ba521621c78 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:28.821548 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-faa795a7-bc3e-4277-bfa5-7ba521621c78 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1293 microversion: 2.1 time: 0.144129 Jul 27 04:29:28.823488 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 358/703] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:28 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1293 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:29:29.032129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f501f424-f8ae-4eca-99e5-761057b4f9a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:29.032751 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f501f424-f8ae-4eca-99e5-761057b4f9a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:29.040151 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f501f424-f8ae-4eca-99e5-761057b4f9a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:29.040606 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f501f424-f8ae-4eca-99e5-761057b4f9a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:29.041385 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f501f424-f8ae-4eca-99e5-761057b4f9a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:29.042037 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f501f424-f8ae-4eca-99e5-761057b4f9a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:29.110668 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f501f424-f8ae-4eca-99e5-761057b4f9a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:29.118172 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f501f424-f8ae-4eca-99e5-761057b4f9a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1288 microversion: 2.1 time: 0.090477 Jul 27 04:29:29.118741 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 346/704] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:29 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:29.845009 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-fbd083d2-f3ac-43cc-95c2-9678080df565 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:29.845622 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-fbd083d2-f3ac-43cc-95c2-9678080df565 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:29.852306 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fbd083d2-f3ac-43cc-95c2-9678080df565 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:29.853004 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fbd083d2-f3ac-43cc-95c2-9678080df565 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:29.853778 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fbd083d2-f3ac-43cc-95c2-9678080df565 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:29.854244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fbd083d2-f3ac-43cc-95c2-9678080df565 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:29.947186 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-fbd083d2-f3ac-43cc-95c2-9678080df565 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:29.955388 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-fbd083d2-f3ac-43cc-95c2-9678080df565 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1299 microversion: 2.1 time: 0.114993 Jul 27 04:29:29.969177 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 359/705] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:29 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:30.140598 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f80295f7-8fc7-442b-ab69-15eeced388ca tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:30.141208 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f80295f7-8fc7-442b-ab69-15eeced388ca tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:30.148424 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f80295f7-8fc7-442b-ab69-15eeced388ca tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:30.148863 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f80295f7-8fc7-442b-ab69-15eeced388ca tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:30.149619 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f80295f7-8fc7-442b-ab69-15eeced388ca tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:30.150254 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f80295f7-8fc7-442b-ab69-15eeced388ca tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:30.220582 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f80295f7-8fc7-442b-ab69-15eeced388ca tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:30.229423 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f80295f7-8fc7-442b-ab69-15eeced388ca tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1294 microversion: 2.1 time: 0.093031 Jul 27 04:29:30.230022 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 347/706] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:30 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:30.976851 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-5e0de5c0-222d-48d5-b175-555376f654f6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:30.977323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-5e0de5c0-222d-48d5-b175-555376f654f6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:30.983636 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5e0de5c0-222d-48d5-b175-555376f654f6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:30.984079 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5e0de5c0-222d-48d5-b175-555376f654f6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:30.984863 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5e0de5c0-222d-48d5-b175-555376f654f6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:30.985533 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5e0de5c0-222d-48d5-b175-555376f654f6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:31.254106 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8e7b9baa-3d53-44e8-ad0b-11b50f8b4b55 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:31.254866 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8e7b9baa-3d53-44e8-ad0b-11b50f8b4b55 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:31.261056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8e7b9baa-3d53-44e8-ad0b-11b50f8b4b55 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:31.261582 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8e7b9baa-3d53-44e8-ad0b-11b50f8b4b55 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:31.262413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8e7b9baa-3d53-44e8-ad0b-11b50f8b4b55 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:31.262892 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8e7b9baa-3d53-44e8-ad0b-11b50f8b4b55 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:31.280523 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-5e0de5c0-222d-48d5-b175-555376f654f6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:31.289349 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-5e0de5c0-222d-48d5-b175-555376f654f6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1366 microversion: 2.1 time: 0.316168 Jul 27 04:29:31.291099 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 360/707] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:30 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:31.413367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8e7b9baa-3d53-44e8-ad0b-11b50f8b4b55 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:31.421534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8e7b9baa-3d53-44e8-ad0b-11b50f8b4b55 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1361 microversion: 2.1 time: 0.172002 Jul 27 04:29:31.422408 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 348/708] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:31 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:31.750379 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-1db24d2f-c8e2-4691-9b3a-d947a000218a req-ee540505-ec6e-4421-8515-e432d7ecadc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "995a6cca-8a06-4a14-9825-6961ef0a7785", "tag": "916e92c2-3bae-413e-9dd4-35df32b29160"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:31.761799 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-1db24d2f-c8e2-4691-9b3a-d947a000218a req-ee540505-ec6e-4421-8515-e432d7ecadc8 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:31.762531 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-1db24d2f-c8e2-4691-9b3a-d947a000218a req-ee540505-ec6e-4421-8515-e432d7ecadc8 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:31.795594 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-1db24d2f-c8e2-4691-9b3a-d947a000218a req-ee540505-ec6e-4421-8515-e432d7ecadc8 service nova] Creating event network-changed:916e92c2-3bae-413e-9dd4-35df32b29160 for instance 995a6cca-8a06-4a14-9825-6961ef0a7785 on hv-cinder-85098 Jul 27 04:29:31.801899 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-1db24d2f-c8e2-4691-9b3a-d947a000218a req-ee540505-ec6e-4421-8515-e432d7ecadc8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059487 Jul 27 04:29:31.803116 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 361/709] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:31.909343 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2082972762", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1427079078", "security_groups": [{"name": "tempest-secgroup-smoke-245786739"}], "block_device_mapping_v2": [{"uuid": "1b468bc1-ca11-4e40-9a54-217562a12006", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87fd5d56-0e62-4bdf-a522-882668de212a"}]}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:32.048903 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] validate_networks() for [('87fd5d56-0e62-4bdf-a522-882668de212a', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:29:32.313241 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a2329c20-19a2-4179-9868-e7642fa3bb28 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:32.314267 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a2329c20-19a2-4179-9868-e7642fa3bb28 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:32.327345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a2329c20-19a2-4179-9868-e7642fa3bb28 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:32.327841 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a2329c20-19a2-4179-9868-e7642fa3bb28 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:32.328632 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a2329c20-19a2-4179-9868-e7642fa3bb28 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:32.329071 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a2329c20-19a2-4179-9868-e7642fa3bb28 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:32.490376 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:29:32.490867 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:29:32.491257 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:29:32.491662 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:29:32.492440 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:29:32.501490 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:32.501949 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:32.502945 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:32.503572 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:32.520099 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Getting quotas for project 3825c2630a4f47e0b029bd0c90875108. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:29:32.523828 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Getting quotas for user eea5b08eede4409484dc2f4305b5298a and project 3825c2630a4f47e0b029bd0c90875108. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:29:32.589332 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:29:32.591862 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1b468bc1-ca11-4e40-9a54-217562a12006',volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:29:32.593230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a2329c20-19a2-4179-9868-e7642fa3bb28 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:32.601017 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a2329c20-19a2-4179-9868-e7642fa3bb28 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1366 microversion: 2.1 time: 0.292719 Jul 27 04:29:32.601584 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 362/710] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:32 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:29:32.606041 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-541829fa-9c6e-4fc6-8e2e-d9dd28ebadc6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:32.606962 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-541829fa-9c6e-4fc6-8e2e-d9dd28ebadc6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:32.610281 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:32.614232 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-541829fa-9c6e-4fc6-8e2e-d9dd28ebadc6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:32.614753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-541829fa-9c6e-4fc6-8e2e-d9dd28ebadc6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:32.615597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-541829fa-9c6e-4fc6-8e2e-d9dd28ebadc6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:32.616104 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-541829fa-9c6e-4fc6-8e2e-d9dd28ebadc6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:32.731197 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d7c4ee6e-5346-4ff7-8f78-656b49ece509 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.825564 Jul 27 04:29:32.732791 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 349/711] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:29:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:29:32.743825 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-704a5ecc-6784-4def-96f0-0f626d6b40e4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:32.745055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-704a5ecc-6784-4def-96f0-0f626d6b40e4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:32.756695 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-541829fa-9c6e-4fc6-8e2e-d9dd28ebadc6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:32.765811 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-541829fa-9c6e-4fc6-8e2e-d9dd28ebadc6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1361 microversion: 2.1 time: 0.163194 Jul 27 04:29:32.766639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 363/712] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:32 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:32.801429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-704a5ecc-6784-4def-96f0-0f626d6b40e4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:32.808213 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-704a5ecc-6784-4def-96f0-0f626d6b40e4 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1095 microversion: 2.1 time: 0.068650 Jul 27 04:29:32.808789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 350/713] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:32 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:33.622322 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d0f341c8-983b-4056-b396-7e9544592df1 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:33.623143 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d0f341c8-983b-4056-b396-7e9544592df1 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:33.629518 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d0f341c8-983b-4056-b396-7e9544592df1 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:33.630000 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d0f341c8-983b-4056-b396-7e9544592df1 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:33.630761 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d0f341c8-983b-4056-b396-7e9544592df1 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:33.631186 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d0f341c8-983b-4056-b396-7e9544592df1 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:33.789330 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d6078190-8736-4085-9aec-0a307ae7f82f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:33.789959 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d6078190-8736-4085-9aec-0a307ae7f82f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:33.799150 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d6078190-8736-4085-9aec-0a307ae7f82f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:33.800110 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d6078190-8736-4085-9aec-0a307ae7f82f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:33.801028 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d6078190-8736-4085-9aec-0a307ae7f82f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:33.801893 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d6078190-8736-4085-9aec-0a307ae7f82f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:33.919140 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d0f341c8-983b-4056-b396-7e9544592df1 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:33.929154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d0f341c8-983b-4056-b396-7e9544592df1 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1366 microversion: 2.1 time: 0.310614 Jul 27 04:29:33.931526 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 364/714] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:33 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:33.943305 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3105a43c-8536-4061-91bb-300ed19a1742 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:33.944431 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3105a43c-8536-4061-91bb-300ed19a1742 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:33.954360 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3105a43c-8536-4061-91bb-300ed19a1742 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:33.955186 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3105a43c-8536-4061-91bb-300ed19a1742 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:33.956340 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3105a43c-8536-4061-91bb-300ed19a1742 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:33.956846 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3105a43c-8536-4061-91bb-300ed19a1742 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:34.028410 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d6078190-8736-4085-9aec-0a307ae7f82f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:34.036686 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d6078190-8736-4085-9aec-0a307ae7f82f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1361 microversion: 2.1 time: 0.252432 Jul 27 04:29:34.037264 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 351/715] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:33 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:29:34.042270 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-e78c483b-18e8-4661-b4c5-2a38dcbcd618 req-4a03a27f-b7a8-458b-a858-2f7bed780faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066cbb5b-1fe9-4c3d-b721-8962ce4f9b53", "tag": "24147a21-2fff-4b3f-acae-bcae05c1ad81"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:34.052553 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-e78c483b-18e8-4661-b4c5-2a38dcbcd618 req-4a03a27f-b7a8-458b-a858-2f7bed780faa service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:34.052986 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-e78c483b-18e8-4661-b4c5-2a38dcbcd618 req-4a03a27f-b7a8-458b-a858-2f7bed780faa service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:34.065862 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-e78c483b-18e8-4661-b4c5-2a38dcbcd618 req-4a03a27f-b7a8-458b-a858-2f7bed780faa service nova] Creating event network-changed:24147a21-2fff-4b3f-acae-bcae05c1ad81 for instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 on hv-cinder-85098 Jul 27 04:29:34.071659 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-e78c483b-18e8-4661-b4c5-2a38dcbcd618 req-4a03a27f-b7a8-458b-a858-2f7bed780faa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032820 Jul 27 04:29:34.072381 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 352/716] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:34.086303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3105a43c-8536-4061-91bb-300ed19a1742 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:34.094298 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3105a43c-8536-4061-91bb-300ed19a1742 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1211 microversion: 2.1 time: 0.161376 Jul 27 04:29:34.094869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 365/717] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:33 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1211 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:34.954138 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0f517df2-1b88-4886-b649-7563d8f40eb7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:34.954952 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0f517df2-1b88-4886-b649-7563d8f40eb7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:34.962702 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0f517df2-1b88-4886-b649-7563d8f40eb7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:34.963797 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0f517df2-1b88-4886-b649-7563d8f40eb7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:34.964472 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0f517df2-1b88-4886-b649-7563d8f40eb7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:34.965701 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0f517df2-1b88-4886-b649-7563d8f40eb7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:35.058959 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-91166051-4407-4088-98b5-3803d7ccc87b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:35.059615 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-91166051-4407-4088-98b5-3803d7ccc87b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:35.072344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-91166051-4407-4088-98b5-3803d7ccc87b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:35.074623 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-91166051-4407-4088-98b5-3803d7ccc87b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:35.075704 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-91166051-4407-4088-98b5-3803d7ccc87b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:35.082550 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-91166051-4407-4088-98b5-3803d7ccc87b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:35.214849 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-0f517df2-1b88-4886-b649-7563d8f40eb7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:35.229341 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0f517df2-1b88-4886-b649-7563d8f40eb7 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1366 microversion: 2.1 time: 0.280812 Jul 27 04:29:35.239553 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 353/718] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:34 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:35.248345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-22e431ef-94e7-4199-99a7-e6b5cf0c3697 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:35.249357 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-22e431ef-94e7-4199-99a7-e6b5cf0c3697 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:35.256056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-22e431ef-94e7-4199-99a7-e6b5cf0c3697 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:35.256507 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-22e431ef-94e7-4199-99a7-e6b5cf0c3697 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:35.257277 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-22e431ef-94e7-4199-99a7-e6b5cf0c3697 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:35.257888 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-22e431ef-94e7-4199-99a7-e6b5cf0c3697 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:35.314112 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-91166051-4407-4088-98b5-3803d7ccc87b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:35.322613 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-91166051-4407-4088-98b5-3803d7ccc87b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1361 microversion: 2.1 time: 0.267407 Jul 27 04:29:35.323454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 366/719] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:35 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:35.503996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-22e431ef-94e7-4199-99a7-e6b5cf0c3697 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:35.511905 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-22e431ef-94e7-4199-99a7-e6b5cf0c3697 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1266 microversion: 2.1 time: 0.271225 Jul 27 04:29:35.512846 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 354/720] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:35 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:36.157697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-46917a29-779d-4066-b82c-846319176e2a req-cbadfb16-c473-4482-adab-4fd9bd844c93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e57f119-e51a-48e1-a962-88581d0864fa", "tag": "3800c112-02a8-4dbf-838b-dd08425bca2f"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:36.178876 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-46917a29-779d-4066-b82c-846319176e2a req-cbadfb16-c473-4482-adab-4fd9bd844c93 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:36.183010 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-46917a29-779d-4066-b82c-846319176e2a req-cbadfb16-c473-4482-adab-4fd9bd844c93 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:36.200567 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-46917a29-779d-4066-b82c-846319176e2a req-cbadfb16-c473-4482-adab-4fd9bd844c93 service nova] Creating event network-changed:3800c112-02a8-4dbf-838b-dd08425bca2f for instance 3e57f119-e51a-48e1-a962-88581d0864fa on hv-cinder-85098 Jul 27 04:29:36.205956 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-46917a29-779d-4066-b82c-846319176e2a req-cbadfb16-c473-4482-adab-4fd9bd844c93 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056522 Jul 27 04:29:36.207239 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 367/721] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:36.252043 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-61362512-c0ca-4d7e-a558-658e6c7f9f53 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:36.252909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-61362512-c0ca-4d7e-a558-658e6c7f9f53 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:36.259763 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-61362512-c0ca-4d7e-a558-658e6c7f9f53 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:36.260351 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-61362512-c0ca-4d7e-a558-658e6c7f9f53 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:36.261333 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-61362512-c0ca-4d7e-a558-658e6c7f9f53 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:36.261909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-61362512-c0ca-4d7e-a558-658e6c7f9f53 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:36.352706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-2d0c70e0-e683-4bf1-9806-347103ec2891 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:36.354384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-2d0c70e0-e683-4bf1-9806-347103ec2891 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:36.364237 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2d0c70e0-e683-4bf1-9806-347103ec2891 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:36.364802 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2d0c70e0-e683-4bf1-9806-347103ec2891 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:36.365714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2d0c70e0-e683-4bf1-9806-347103ec2891 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:36.366332 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2d0c70e0-e683-4bf1-9806-347103ec2891 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:36.493309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-61362512-c0ca-4d7e-a558-658e6c7f9f53 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:36.503192 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-61362512-c0ca-4d7e-a558-658e6c7f9f53 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1366 microversion: 2.1 time: 0.255845 Jul 27 04:29:36.503763 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 355/722] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:36 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:36.516536 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-2d0c70e0-e683-4bf1-9806-347103ec2891 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:36.524134 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-2d0c70e0-e683-4bf1-9806-347103ec2891 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1361 microversion: 2.1 time: 0.177283 Jul 27 04:29:36.524825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 368/723] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:36 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:29:36.537359 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-eace79c7-4344-4e26-bf75-92622b067cf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:36.537990 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-eace79c7-4344-4e26-bf75-92622b067cf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:36.543878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-eace79c7-4344-4e26-bf75-92622b067cf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:36.544885 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-eace79c7-4344-4e26-bf75-92622b067cf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:36.545902 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-eace79c7-4344-4e26-bf75-92622b067cf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:36.546376 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-eace79c7-4344-4e26-bf75-92622b067cf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:36.752123 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-eace79c7-4344-4e26-bf75-92622b067cf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:36.760539 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-eace79c7-4344-4e26-bf75-92622b067cf6 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1266 microversion: 2.1 time: 0.227340 Jul 27 04:29:36.761454 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 356/724] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:36 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:37.524414 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8532f1c3-8cf8-4d5b-b3a2-eee766873971 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:37.525022 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-8532f1c3-8cf8-4d5b-b3a2-eee766873971 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:37.531655 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8532f1c3-8cf8-4d5b-b3a2-eee766873971 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:37.532094 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8532f1c3-8cf8-4d5b-b3a2-eee766873971 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:37.532851 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8532f1c3-8cf8-4d5b-b3a2-eee766873971 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:37.533278 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8532f1c3-8cf8-4d5b-b3a2-eee766873971 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:37.548133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-a7be049d-e9cc-45a5-9db7-49e487167c45 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:37.549666 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-a7be049d-e9cc-45a5-9db7-49e487167c45 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:37.556977 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a7be049d-e9cc-45a5-9db7-49e487167c45 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:37.557552 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a7be049d-e9cc-45a5-9db7-49e487167c45 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:37.558550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a7be049d-e9cc-45a5-9db7-49e487167c45 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:37.558988 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a7be049d-e9cc-45a5-9db7-49e487167c45 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:37.684729 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-8532f1c3-8cf8-4d5b-b3a2-eee766873971 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:37.692235 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8532f1c3-8cf8-4d5b-b3a2-eee766873971 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1366 microversion: 2.1 time: 0.171679 Jul 27 04:29:37.692806 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 369/725] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:37 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:37.782535 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-09073c4d-1861-4733-8b0e-6d6a5efb5db3 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:37.783242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-09073c4d-1861-4733-8b0e-6d6a5efb5db3 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:37.785206 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:37.786095 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=10 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:37.793510 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-a7be049d-e9cc-45a5-9db7-49e487167c45 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:37.801828 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-09073c4d-1861-4733-8b0e-6d6a5efb5db3 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:37.802967 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-09073c4d-1861-4733-8b0e-6d6a5efb5db3 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:37.804014 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-09073c4d-1861-4733-8b0e-6d6a5efb5db3 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:37.804390 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-a7be049d-e9cc-45a5-9db7-49e487167c45 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1361 microversion: 2.1 time: 0.261388 Jul 27 04:29:37.804612 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-09073c4d-1861-4733-8b0e-6d6a5efb5db3 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:37.804979 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 357/726] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:37 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:37.900534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-08608ef7-0669-4805-aaba-315ffe800d66 req-ab158b3f-9281-40bb-8253-489001fe2550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066cbb5b-1fe9-4c3d-b721-8962ce4f9b53", "name": "network-vif-plugged", "status": "completed", "tag": "24147a21-2fff-4b3f-acae-bcae05c1ad81"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:37.911897 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-08608ef7-0669-4805-aaba-315ffe800d66 req-ab158b3f-9281-40bb-8253-489001fe2550 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:37.912747 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-08608ef7-0669-4805-aaba-315ffe800d66 req-ab158b3f-9281-40bb-8253-489001fe2550 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:37.927462 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-08608ef7-0669-4805-aaba-315ffe800d66 req-ab158b3f-9281-40bb-8253-489001fe2550 service nova] Creating event network-vif-plugged:24147a21-2fff-4b3f-acae-bcae05c1ad81 for instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 on hv-cinder-85098 Jul 27 04:29:37.932537 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-08608ef7-0669-4805-aaba-315ffe800d66 req-ab158b3f-9281-40bb-8253-489001fe2550 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035688 Jul 27 04:29:37.933138 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 358/727] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:29:37.950860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-09073c4d-1861-4733-8b0e-6d6a5efb5db3 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:37.960090 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-09073c4d-1861-4733-8b0e-6d6a5efb5db3 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1266 microversion: 2.1 time: 0.182260 Jul 27 04:29:37.960839 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 370/728] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:37 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:38.715345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-724d64f4-0132-48d7-b9a8-291bbe6d4347 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:38.715964 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-724d64f4-0132-48d7-b9a8-291bbe6d4347 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:38.722628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-724d64f4-0132-48d7-b9a8-291bbe6d4347 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:38.723080 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-724d64f4-0132-48d7-b9a8-291bbe6d4347 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:38.723846 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-724d64f4-0132-48d7-b9a8-291bbe6d4347 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:38.724284 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-724d64f4-0132-48d7-b9a8-291bbe6d4347 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:38.827231 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-cf39a585-00a4-454d-b5bf-427e4268cd7f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:38.827886 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-cf39a585-00a4-454d-b5bf-427e4268cd7f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:38.834276 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cf39a585-00a4-454d-b5bf-427e4268cd7f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:38.834722 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cf39a585-00a4-454d-b5bf-427e4268cd7f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:38.835486 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cf39a585-00a4-454d-b5bf-427e4268cd7f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:38.835914 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cf39a585-00a4-454d-b5bf-427e4268cd7f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:38.860500 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-724d64f4-0132-48d7-b9a8-291bbe6d4347 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:38.868358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-724d64f4-0132-48d7-b9a8-291bbe6d4347 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1366 microversion: 2.1 time: 0.157760 Jul 27 04:29:38.868925 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 359/729] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:38 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:38.971179 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-cf39a585-00a4-454d-b5bf-427e4268cd7f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:38.978643 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-cf39a585-00a4-454d-b5bf-427e4268cd7f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1361 microversion: 2.1 time: 0.156357 Jul 27 04:29:38.979195 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 371/730] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:38 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:29:38.980559 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2c02b870-d3cd-41e9-a7d7-b23a9e61d992 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:38.981178 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2c02b870-d3cd-41e9-a7d7-b23a9e61d992 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:38.990576 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2c02b870-d3cd-41e9-a7d7-b23a9e61d992 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:38.991025 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2c02b870-d3cd-41e9-a7d7-b23a9e61d992 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:38.991828 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2c02b870-d3cd-41e9-a7d7-b23a9e61d992 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:38.992260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2c02b870-d3cd-41e9-a7d7-b23a9e61d992 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:39.128025 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2c02b870-d3cd-41e9-a7d7-b23a9e61d992 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:39.136540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2c02b870-d3cd-41e9-a7d7-b23a9e61d992 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1266 microversion: 2.1 time: 0.159791 Jul 27 04:29:39.137153 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 360/731] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:38 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:29:39.889999 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3b4307b3-2fb1-4db1-9dc1-1c592161e759 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:39.890637 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3b4307b3-2fb1-4db1-9dc1-1c592161e759 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:39.897022 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3b4307b3-2fb1-4db1-9dc1-1c592161e759 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:39.897459 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3b4307b3-2fb1-4db1-9dc1-1c592161e759 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:39.898242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3b4307b3-2fb1-4db1-9dc1-1c592161e759 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:39.898673 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3b4307b3-2fb1-4db1-9dc1-1c592161e759 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:39.948733 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-75d6e5c0-ab49-491c-bd18-3e98e5f3f8f1 req-0345c9b2-2b0b-4099-9a38-529cd98c14a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "995a6cca-8a06-4a14-9825-6961ef0a7785", "name": "network-vif-plugged", "status": "completed", "tag": "916e92c2-3bae-413e-9dd4-35df32b29160"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:39.959481 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-75d6e5c0-ab49-491c-bd18-3e98e5f3f8f1 req-0345c9b2-2b0b-4099-9a38-529cd98c14a7 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:39.959919 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-75d6e5c0-ab49-491c-bd18-3e98e5f3f8f1 req-0345c9b2-2b0b-4099-9a38-529cd98c14a7 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:39.971691 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-75d6e5c0-ab49-491c-bd18-3e98e5f3f8f1 req-0345c9b2-2b0b-4099-9a38-529cd98c14a7 service nova] Creating event network-vif-plugged:916e92c2-3bae-413e-9dd4-35df32b29160 for instance 995a6cca-8a06-4a14-9825-6961ef0a7785 on hv-cinder-85098 Jul 27 04:29:39.976567 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-75d6e5c0-ab49-491c-bd18-3e98e5f3f8f1 req-0345c9b2-2b0b-4099-9a38-529cd98c14a7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031686 Jul 27 04:29:39.977260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 361/732] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:29:40.000690 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-180ef8ca-261c-49ea-ac60-6e8081f19873 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:40.001394 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-180ef8ca-261c-49ea-ac60-6e8081f19873 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:40.007832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-180ef8ca-261c-49ea-ac60-6e8081f19873 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:40.008331 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-180ef8ca-261c-49ea-ac60-6e8081f19873 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:40.009158 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-180ef8ca-261c-49ea-ac60-6e8081f19873 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:40.009591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-180ef8ca-261c-49ea-ac60-6e8081f19873 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:40.013882 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:40.037749 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3b4307b3-2fb1-4db1-9dc1-1c592161e759 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:40.048073 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3b4307b3-2fb1-4db1-9dc1-1c592161e759 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1366 microversion: 2.1 time: 0.162447 Jul 27 04:29:40.048656 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 372/733] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:39 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:40.158207 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-58fc3b49-2762-4589-a3e9-a12951175c80 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:40.158728 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-58fc3b49-2762-4589-a3e9-a12951175c80 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:40.164749 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-58fc3b49-2762-4589-a3e9-a12951175c80 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:40.165202 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-58fc3b49-2762-4589-a3e9-a12951175c80 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:40.166037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-58fc3b49-2762-4589-a3e9-a12951175c80 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:40.166480 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-58fc3b49-2762-4589-a3e9-a12951175c80 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:40.185668 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-180ef8ca-261c-49ea-ac60-6e8081f19873 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:40.193580 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-180ef8ca-261c-49ea-ac60-6e8081f19873 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1544 microversion: 2.1 time: 0.197959 Jul 27 04:29:40.194416 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 362/734] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:39 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1544 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:29:40.214300 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-527cf17b-8710-4227-88eb-7f6c51b2be17 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:40.214795 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-527cf17b-8710-4227-88eb-7f6c51b2be17 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:40.221246 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-527cf17b-8710-4227-88eb-7f6c51b2be17 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:40.221663 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-527cf17b-8710-4227-88eb-7f6c51b2be17 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:40.222458 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-527cf17b-8710-4227-88eb-7f6c51b2be17 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:40.222886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-527cf17b-8710-4227-88eb-7f6c51b2be17 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:40.301873 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-527cf17b-8710-4227-88eb-7f6c51b2be17 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091479 Jul 27 04:29:40.302516 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 363/735] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Jul 27 04:29:40 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:40.304750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-58fc3b49-2762-4589-a3e9-a12951175c80 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:40.312786 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-58fc3b49-2762-4589-a3e9-a12951175c80 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1266 microversion: 2.1 time: 0.159311 Jul 27 04:29:40.313379 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 373/736] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:40 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:29:41.069686 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-84f0914b-7a47-4ec0-a212-057a2a1c1362 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:41.070287 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-84f0914b-7a47-4ec0-a212-057a2a1c1362 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:41.077176 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-84f0914b-7a47-4ec0-a212-057a2a1c1362 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:41.077626 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-84f0914b-7a47-4ec0-a212-057a2a1c1362 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:41.078423 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-84f0914b-7a47-4ec0-a212-057a2a1c1362 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:41.078852 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-84f0914b-7a47-4ec0-a212-057a2a1c1362 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:41.211768 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-84f0914b-7a47-4ec0-a212-057a2a1c1362 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:41.219750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-84f0914b-7a47-4ec0-a212-057a2a1c1362 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1366 microversion: 2.1 time: 0.154532 Jul 27 04:29:41.220322 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 364/737] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:41 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:41.334730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0a3bbf54-6963-4d8c-b5cb-9f3a6a5ef819 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:41.335353 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0a3bbf54-6963-4d8c-b5cb-9f3a6a5ef819 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:41.342462 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0a3bbf54-6963-4d8c-b5cb-9f3a6a5ef819 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:41.342913 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0a3bbf54-6963-4d8c-b5cb-9f3a6a5ef819 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:41.343687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0a3bbf54-6963-4d8c-b5cb-9f3a6a5ef819 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:41.344123 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0a3bbf54-6963-4d8c-b5cb-9f3a6a5ef819 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:41.362333 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=100 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:41.505889 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-7798f803-c6c7-4fcd-9db9-fefcb72135c8 req-f4353953-a9db-4174-b67e-e714b9b4502d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066cbb5b-1fe9-4c3d-b721-8962ce4f9b53", "tag": "24147a21-2fff-4b3f-acae-bcae05c1ad81"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:41.516705 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-7798f803-c6c7-4fcd-9db9-fefcb72135c8 req-f4353953-a9db-4174-b67e-e714b9b4502d service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:41.517378 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-7798f803-c6c7-4fcd-9db9-fefcb72135c8 req-f4353953-a9db-4174-b67e-e714b9b4502d service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:41.529871 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-7798f803-c6c7-4fcd-9db9-fefcb72135c8 req-f4353953-a9db-4174-b67e-e714b9b4502d service nova] Creating event network-changed:24147a21-2fff-4b3f-acae-bcae05c1ad81 for instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 on hv-cinder-85098 Jul 27 04:29:41.531830 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0a3bbf54-6963-4d8c-b5cb-9f3a6a5ef819 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:41.534715 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-7798f803-c6c7-4fcd-9db9-fefcb72135c8 req-f4353953-a9db-4174-b67e-e714b9b4502d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033235 Jul 27 04:29:41.535477 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 365/738] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:29:41.541228 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0a3bbf54-6963-4d8c-b5cb-9f3a6a5ef819 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1266 microversion: 2.1 time: 0.210310 Jul 27 04:29:41.541906 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 374/739] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:41 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:42.241353 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9e65db4d-b2da-4b52-b17b-b5c43ed00ae8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:42.242078 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9e65db4d-b2da-4b52-b17b-b5c43ed00ae8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:42.249233 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9e65db4d-b2da-4b52-b17b-b5c43ed00ae8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:42.249683 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9e65db4d-b2da-4b52-b17b-b5c43ed00ae8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:42.250498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9e65db4d-b2da-4b52-b17b-b5c43ed00ae8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:42.250936 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9e65db4d-b2da-4b52-b17b-b5c43ed00ae8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:42.387067 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9e65db4d-b2da-4b52-b17b-b5c43ed00ae8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:42.395617 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9e65db4d-b2da-4b52-b17b-b5c43ed00ae8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1556 microversion: 2.1 time: 0.158846 Jul 27 04:29:42.396208 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 366/740] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:42 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:42.416116 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4bacb350-2b41-4c66-8035-5d066547d2e4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:42.416643 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4bacb350-2b41-4c66-8035-5d066547d2e4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:42.423407 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4bacb350-2b41-4c66-8035-5d066547d2e4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:42.423939 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4bacb350-2b41-4c66-8035-5d066547d2e4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:42.425716 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4bacb350-2b41-4c66-8035-5d066547d2e4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:42.426201 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4bacb350-2b41-4c66-8035-5d066547d2e4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:42.506053 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4bacb350-2b41-4c66-8035-5d066547d2e4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093768 Jul 27 04:29:42.506647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 375/741] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Jul 27 04:29:42 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:42.563851 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-304e1887-7a0e-49e7-b1c5-3712bbb7be99 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:42.564652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-304e1887-7a0e-49e7-b1c5-3712bbb7be99 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:42.571427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=4 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:42.579637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-304e1887-7a0e-49e7-b1c5-3712bbb7be99 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:42.580086 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-304e1887-7a0e-49e7-b1c5-3712bbb7be99 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:42.580865 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-304e1887-7a0e-49e7-b1c5-3712bbb7be99 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:42.581328 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-304e1887-7a0e-49e7-b1c5-3712bbb7be99 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:42.764709 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-304e1887-7a0e-49e7-b1c5-3712bbb7be99 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:42.772884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-304e1887-7a0e-49e7-b1c5-3712bbb7be99 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1266 microversion: 2.1 time: 0.214282 Jul 27 04:29:42.773803 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 367/742] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:42 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:43.549448 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-35080832-8ecc-4ab4-837b-ff286593f317 req-67d4c627-f8a0-44c9-953f-f1efaa4e1b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "995a6cca-8a06-4a14-9825-6961ef0a7785", "tag": "916e92c2-3bae-413e-9dd4-35df32b29160"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:43.558953 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-35080832-8ecc-4ab4-837b-ff286593f317 req-67d4c627-f8a0-44c9-953f-f1efaa4e1b1e service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:43.559468 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-35080832-8ecc-4ab4-837b-ff286593f317 req-67d4c627-f8a0-44c9-953f-f1efaa4e1b1e service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:43.572440 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-35080832-8ecc-4ab4-837b-ff286593f317 req-67d4c627-f8a0-44c9-953f-f1efaa4e1b1e service nova] Creating event network-changed:916e92c2-3bae-413e-9dd4-35df32b29160 for instance 995a6cca-8a06-4a14-9825-6961ef0a7785 on hv-cinder-85098 Jul 27 04:29:43.578035 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-35080832-8ecc-4ab4-837b-ff286593f317 req-67d4c627-f8a0-44c9-953f-f1efaa4e1b1e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032715 Jul 27 04:29:43.578634 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 376/743] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:43.796493 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-78f346f4-403c-43ed-885d-07e895d2b7bd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:43.797987 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-78f346f4-403c-43ed-885d-07e895d2b7bd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:43.804316 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=22 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:43.808654 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-78f346f4-403c-43ed-885d-07e895d2b7bd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:43.809104 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-78f346f4-403c-43ed-885d-07e895d2b7bd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:43.811278 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-78f346f4-403c-43ed-885d-07e895d2b7bd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:43.811881 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-78f346f4-403c-43ed-885d-07e895d2b7bd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:44.058357 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-78f346f4-403c-43ed-885d-07e895d2b7bd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:44.066810 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-78f346f4-403c-43ed-885d-07e895d2b7bd tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1266 microversion: 2.1 time: 0.275843 Jul 27 04:29:44.067396 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 368/744] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:43 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:45.090390 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3781e745-ea77-45cf-b7a1-f9b973606db8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:45.091091 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3781e745-ea77-45cf-b7a1-f9b973606db8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:45.101135 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3781e745-ea77-45cf-b7a1-f9b973606db8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:45.101580 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3781e745-ea77-45cf-b7a1-f9b973606db8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:45.102400 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3781e745-ea77-45cf-b7a1-f9b973606db8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:45.102833 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3781e745-ea77-45cf-b7a1-f9b973606db8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:45.233337 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3781e745-ea77-45cf-b7a1-f9b973606db8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:45.240672 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3781e745-ea77-45cf-b7a1-f9b973606db8 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1266 microversion: 2.1 time: 0.156915 Jul 27 04:29:45.241233 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 377/745] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:45 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:45.921142 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-25e84176-7c28-4678-9f9f-602fb6514e11 req-34fafd54-4d2b-40a1-bbb5-3e57ce93ca2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e57f119-e51a-48e1-a962-88581d0864fa", "name": "network-vif-plugged", "status": "completed", "tag": "3800c112-02a8-4dbf-838b-dd08425bca2f"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:45.931482 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-25e84176-7c28-4678-9f9f-602fb6514e11 req-34fafd54-4d2b-40a1-bbb5-3e57ce93ca2a service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:45.931928 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-25e84176-7c28-4678-9f9f-602fb6514e11 req-34fafd54-4d2b-40a1-bbb5-3e57ce93ca2a service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:45.944497 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-25e84176-7c28-4678-9f9f-602fb6514e11 req-34fafd54-4d2b-40a1-bbb5-3e57ce93ca2a service nova] Creating event network-vif-plugged:3800c112-02a8-4dbf-838b-dd08425bca2f for instance 3e57f119-e51a-48e1-a962-88581d0864fa on hv-cinder-85098 Jul 27 04:29:45.949480 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-25e84176-7c28-4678-9f9f-602fb6514e11 req-34fafd54-4d2b-40a1-bbb5-3e57ce93ca2a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032189 Jul 27 04:29:45.950448 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 369/746] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:29:46.261128 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-77b2361d-f218-49ca-937a-b9c11c7fe23b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:46.261739 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-77b2361d-f218-49ca-937a-b9c11c7fe23b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:46.268359 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-77b2361d-f218-49ca-937a-b9c11c7fe23b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:46.268802 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-77b2361d-f218-49ca-937a-b9c11c7fe23b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:46.269558 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-77b2361d-f218-49ca-937a-b9c11c7fe23b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:46.270006 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-77b2361d-f218-49ca-937a-b9c11c7fe23b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:46.404280 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-77b2361d-f218-49ca-937a-b9c11c7fe23b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:46.411922 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-77b2361d-f218-49ca-937a-b9c11c7fe23b tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1266 microversion: 2.1 time: 0.154556 Jul 27 04:29:46.412487 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 378/747] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:46 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:47.433060 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f38085af-d919-483d-853c-87f3898a5b17 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:47.433745 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f38085af-d919-483d-853c-87f3898a5b17 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:47.440097 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f38085af-d919-483d-853c-87f3898a5b17 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:47.440540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f38085af-d919-483d-853c-87f3898a5b17 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:47.441290 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f38085af-d919-483d-853c-87f3898a5b17 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:47.441733 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f38085af-d919-483d-853c-87f3898a5b17 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:47.576622 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f38085af-d919-483d-853c-87f3898a5b17 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:47.584237 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f38085af-d919-483d-853c-87f3898a5b17 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1452 microversion: 2.1 time: 0.155814 Jul 27 04:29:47.584820 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 370/748] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:47 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:47.604645 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-cff91daa-9258-4057-82c3-f2fc5d92fa32 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:29:47.605261 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-cff91daa-9258-4057-82c3-f2fc5d92fa32 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:29:47.612776 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cff91daa-9258-4057-82c3-f2fc5d92fa32 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:47.613230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cff91daa-9258-4057-82c3-f2fc5d92fa32 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:47.614224 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cff91daa-9258-4057-82c3-f2fc5d92fa32 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:47.614666 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cff91daa-9258-4057-82c3-f2fc5d92fa32 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:47.755821 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-cff91daa-9258-4057-82c3-f2fc5d92fa32 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:29:47.763327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-cff91daa-9258-4057-82c3-f2fc5d92fa32 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1452 microversion: 2.1 time: 0.162543 Jul 27 04:29:47.763900 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 379/749] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:29:47 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:29:49.554688 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-1f1671f7-2c9d-488a-96a6-7c4a4b22e526 req-da3a2d61-fd15-4e52-8733-523f402af2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e57f119-e51a-48e1-a962-88581d0864fa", "tag": "3800c112-02a8-4dbf-838b-dd08425bca2f"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:29:49.564688 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-1f1671f7-2c9d-488a-96a6-7c4a4b22e526 req-da3a2d61-fd15-4e52-8733-523f402af2da service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:29:49.565353 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-1f1671f7-2c9d-488a-96a6-7c4a4b22e526 req-da3a2d61-fd15-4e52-8733-523f402af2da service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:29:49.576322 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-1f1671f7-2c9d-488a-96a6-7c4a4b22e526 req-da3a2d61-fd15-4e52-8733-523f402af2da service nova] Creating event network-changed:3800c112-02a8-4dbf-838b-dd08425bca2f for instance 3e57f119-e51a-48e1-a962-88581d0864fa on hv-cinder-85098 Jul 27 04:29:49.581739 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-1f1671f7-2c9d-488a-96a6-7c4a4b22e526 req-da3a2d61-fd15-4e52-8733-523f402af2da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030684 Jul 27 04:29:49.582755 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 371/750] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:19.522532 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-399e70a5-8763-49b6-8e03-719fb5729386 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:19.523064 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-399e70a5-8763-49b6-8e03-719fb5729386 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:19.525309 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=32 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:30:19.526365 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=26 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:30:19.532957 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-399e70a5-8763-49b6-8e03-719fb5729386 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:19.533448 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-399e70a5-8763-49b6-8e03-719fb5729386 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:19.534357 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-399e70a5-8763-49b6-8e03-719fb5729386 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:19.534790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-399e70a5-8763-49b6-8e03-719fb5729386 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:19.557413 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-399e70a5-8763-49b6-8e03-719fb5729386 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/ips" status: 200 len: 150 microversion: 2.1 time: 0.038880 Jul 27 04:30:19.558066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 380/751] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Jul 27 04:30:19 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:20.893641 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:30:20.894913 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=44 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:30:20.899186 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-19a080b6-9cda-4e46-9c7b-67e4f7d687c9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e739ee9-95d3-4179-9d68-5370b93da627"}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:30:20.901829 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-19a080b6-9cda-4e46-9c7b-67e4f7d687c9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:20.910483 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-19a080b6-9cda-4e46-9c7b-67e4f7d687c9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:20.910927 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-19a080b6-9cda-4e46-9c7b-67e4f7d687c9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:20.911691 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-19a080b6-9cda-4e46-9c7b-67e4f7d687c9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:20.912122 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-19a080b6-9cda-4e46-9c7b-67e4f7d687c9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:21.152177 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-19a080b6-9cda-4e46-9c7b-67e4f7d687c9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "POST /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260145 Jul 27 04:30:21.152793 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 372/752] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:30:20 2022] POST /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:25.059012 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ba03bf77-80b5-479d-9f21-49da590586c0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:25.059583 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ba03bf77-80b5-479d-9f21-49da590586c0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:25.066952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba03bf77-80b5-479d-9f21-49da590586c0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:25.067408 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba03bf77-80b5-479d-9f21-49da590586c0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:25.068175 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba03bf77-80b5-479d-9f21-49da590586c0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:25.068609 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba03bf77-80b5-479d-9f21-49da590586c0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:25.092465 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ba03bf77-80b5-479d-9f21-49da590586c0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/ips" status: 200 len: 141 microversion: 2.1 time: 0.037328 Jul 27 04:30:25.093035 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 381/753] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Jul 27 04:30:25 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/ips => generated 141 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:27.152202 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-087b2ffe-64ad-4eb2-a0cf-dcdce67093f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0114cae-f966-4038-8e88-54680604695d"}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:30:27.154784 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-087b2ffe-64ad-4eb2-a0cf-dcdce67093f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:27.161203 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-087b2ffe-64ad-4eb2-a0cf-dcdce67093f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:27.161656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-087b2ffe-64ad-4eb2-a0cf-dcdce67093f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:27.162461 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-087b2ffe-64ad-4eb2-a0cf-dcdce67093f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:27.162901 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-087b2ffe-64ad-4eb2-a0cf-dcdce67093f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:27.582798 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-087b2ffe-64ad-4eb2-a0cf-dcdce67093f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "POST /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.435241 Jul 27 04:30:27.589619 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 373/754] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:30:27 2022] POST /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/os-volume_attachments => generated 194 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:27.652182 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-70d6edd0-4f13-46f3-89e0-a270996ad4e2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e739ee9-95d3-4179-9d68-5370b93da627"}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:30:27.654576 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-70d6edd0-4f13-46f3-89e0-a270996ad4e2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:27.662497 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-70d6edd0-4f13-46f3-89e0-a270996ad4e2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:27.663065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-70d6edd0-4f13-46f3-89e0-a270996ad4e2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:27.663859 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-70d6edd0-4f13-46f3-89e0-a270996ad4e2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:27.664303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-70d6edd0-4f13-46f3-89e0-a270996ad4e2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:27.749847 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-70d6edd0-4f13-46f3-89e0-a270996ad4e2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Invalid volume: volume 5e739ee9-95d3-4179-9d68-5370b93da627 is already attached to instances: 995a6cca-8a06-4a14-9825-6961ef0a7785 Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-70d6edd0-4f13-46f3-89e0-a270996ad4e2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: POST /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments HTTP/1.1 Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 74 Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:30:27.751790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:30:27.753225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:30:27.753225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:30:27.753225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:30:27.753225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:30:27.753225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:30:27.753225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:30:27.753225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:30:27.753225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:30:27.753225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:30:27.753225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Jul 27 04:30:27.753225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {"volumeAttachment": {"volumeId": "5e739ee9-95d3-4179-9d68-5370b93da627"}} Jul 27 04:30:27.753225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Invalid volume: volume 5e739ee9-95d3-4179-9d68-5370b93da627 is already attached to instances: 995a6cca-8a06-4a14-9825-6961ef0a7785 Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'server_id': '995a6cca-8a06-4a14-9825-6961ef0a7785', 'body': {'volumeAttachment': {'volumeId': '5e739ee9-95d3-4179-9d68-5370b93da627'}}} Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5e739ee9-95d3-4179-9d68-5370b93da627 is already attached to instances: 995a6cca-8a06-4a14-9825-6961ef0a7785 Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:30:27.754019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5e739ee9-95d3-4179-9d68-5370b93da627 is already attached to instances: 995a6cca-8a06-4a14-9825-6961ef0a7785 Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:30:27.755275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:30:27.757675 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:30:27.757675 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:30:27.757675 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:30:27.757675 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5e739ee9-95d3-4179-9d68-5370b93da627 is already attached to instances: 995a6cca-8a06-4a14-9825-6961ef0a7785 Jul 27 04:30:27.757675 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:30:27.757675 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-70d6edd0-4f13-46f3-89e0-a270996ad4e2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 400 to user: Invalid volume: volume 5e739ee9-95d3-4179-9d68-5370b93da627 is already attached to instances: 995a6cca-8a06-4a14-9825-6961ef0a7785 {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:30:27.757675 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-70d6edd0-4f13-46f3-89e0-a270996ad4e2 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "POST /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106147 Jul 27 04:30:27.757675 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 382/755] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:30:27 2022] POST /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 04:30:27.818572 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c7a6751f-a1e8-4bd0-b4c9-bce955e5185b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:27.819168 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c7a6751f-a1e8-4bd0-b4c9-bce955e5185b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:27.825557 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c7a6751f-a1e8-4bd0-b4c9-bce955e5185b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:27.826021 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c7a6751f-a1e8-4bd0-b4c9-bce955e5185b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:27.826795 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c7a6751f-a1e8-4bd0-b4c9-bce955e5185b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:27.827226 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c7a6751f-a1e8-4bd0-b4c9-bce955e5185b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:27.909000 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.objects.instance [None req-c7a6751f-a1e8-4bd0-b4c9-bce955e5185b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lazy-loading 'services' on Instance uuid 995a6cca-8a06-4a14-9825-6961ef0a7785 {{(pid=117739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:30:27.980351 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c7a6751f-a1e8-4bd0-b4c9-bce955e5185b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments/5e739ee9-95d3-4179-9d68-5370b93da627" status: 202 len: 0 microversion: 2.1 time: 0.167423 Jul 27 04:30:27.980884 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 374/756] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Jul 27 04:30:27 2022] DELETE /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments/5e739ee9-95d3-4179-9d68-5370b93da627 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:30:27.990678 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9051b634-2430-45d5-a3ad-5bffb319a6e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:27.993125 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-9051b634-2430-45d5-a3ad-5bffb319a6e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:28.000881 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9051b634-2430-45d5-a3ad-5bffb319a6e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:28.001722 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9051b634-2430-45d5-a3ad-5bffb319a6e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:28.002776 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9051b634-2430-45d5-a3ad-5bffb319a6e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:28.003387 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9051b634-2430-45d5-a3ad-5bffb319a6e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:28.035138 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-9051b634-2430-45d5-a3ad-5bffb319a6e8 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048779 Jul 27 04:30:28.035705 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 383/757] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:30:27 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:29.049522 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8aa6c203-6b12-43e7-8d16-89bdc28a17aa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:29.051770 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8aa6c203-6b12-43e7-8d16-89bdc28a17aa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:29.058042 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8aa6c203-6b12-43e7-8d16-89bdc28a17aa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:29.058601 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8aa6c203-6b12-43e7-8d16-89bdc28a17aa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:29.059353 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8aa6c203-6b12-43e7-8d16-89bdc28a17aa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:29.059780 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8aa6c203-6b12-43e7-8d16-89bdc28a17aa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:29.088705 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8aa6c203-6b12-43e7-8d16-89bdc28a17aa tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044561 Jul 27 04:30:29.089248 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 375/758] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:30:29 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:30.101014 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e85c0391-6d70-434e-a61c-d55429e348b9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:30.103175 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e85c0391-6d70-434e-a61c-d55429e348b9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:30.110327 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e85c0391-6d70-434e-a61c-d55429e348b9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:30.110861 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e85c0391-6d70-434e-a61c-d55429e348b9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:30.111654 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e85c0391-6d70-434e-a61c-d55429e348b9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:30.112084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e85c0391-6d70-434e-a61c-d55429e348b9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:30.141505 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e85c0391-6d70-434e-a61c-d55429e348b9 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044479 Jul 27 04:30:30.142078 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 384/759] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:30:30 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:31.153494 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-29d0b93f-94a8-49af-a289-ce3e2f92c6d3 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:31.155667 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-29d0b93f-94a8-49af-a289-ce3e2f92c6d3 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:31.162670 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-29d0b93f-94a8-49af-a289-ce3e2f92c6d3 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:31.163115 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-29d0b93f-94a8-49af-a289-ce3e2f92c6d3 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:31.163873 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-29d0b93f-94a8-49af-a289-ce3e2f92c6d3 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:31.164306 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-29d0b93f-94a8-49af-a289-ce3e2f92c6d3 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:31.194307 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-29d0b93f-94a8-49af-a289-ce3e2f92c6d3 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Jul 27 04:30:31.194852 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 376/760] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:30:31 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:32.206802 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f491d08b-390b-49d6-b659-f993ad85fb05 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:32.208940 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f491d08b-390b-49d6-b659-f993ad85fb05 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:32.215366 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f491d08b-390b-49d6-b659-f993ad85fb05 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:32.215815 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f491d08b-390b-49d6-b659-f993ad85fb05 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:32.216576 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f491d08b-390b-49d6-b659-f993ad85fb05 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:32.217009 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f491d08b-390b-49d6-b659-f993ad85fb05 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:32.245595 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f491d08b-390b-49d6-b659-f993ad85fb05 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042762 Jul 27 04:30:32.246167 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 385/761] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:30:32 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:33.258522 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0b9eb5e7-5807-4dfa-bd24-46214bcb889c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:33.260652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0b9eb5e7-5807-4dfa-bd24-46214bcb889c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:33.267234 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0b9eb5e7-5807-4dfa-bd24-46214bcb889c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:33.267684 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0b9eb5e7-5807-4dfa-bd24-46214bcb889c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:33.268451 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0b9eb5e7-5807-4dfa-bd24-46214bcb889c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:33.268886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0b9eb5e7-5807-4dfa-bd24-46214bcb889c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:33.297914 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0b9eb5e7-5807-4dfa-bd24-46214bcb889c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043393 Jul 27 04:30:33.298498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 377/762] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:30:33 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:34.072980 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1ddcffec-643d-4462-a0ee-12095a7a4a66 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:30:34.079916 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1ddcffec-643d-4462-a0ee-12095a7a4a66 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:34.080316 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1ddcffec-643d-4462-a0ee-12095a7a4a66 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:34.140309 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-1ddcffec-643d-4462-a0ee-12095a7a4a66 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Going to try to stop instance {{(pid=117740) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 27 04:30:34.185529 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-1ddcffec-643d-4462-a0ee-12095a7a4a66 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "POST /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/action" status: 202 len: 0 microversion: 2.1 time: 0.116569 Jul 27 04:30:34.186162 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 386/763] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:30:34 2022] POST /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:30:34.194292 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-175032b6-aed1-4341-bc6d-cd180de3e93b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:34.194933 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-175032b6-aed1-4341-bc6d-cd180de3e93b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:34.202502 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-175032b6-aed1-4341-bc6d-cd180de3e93b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:34.203919 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-175032b6-aed1-4341-bc6d-cd180de3e93b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:34.205406 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-175032b6-aed1-4341-bc6d-cd180de3e93b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:34.206056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-175032b6-aed1-4341-bc6d-cd180de3e93b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:34.311041 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3f7d2735-b328-4764-a10b-31380ebc7c07 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:34.313536 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3f7d2735-b328-4764-a10b-31380ebc7c07 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:34.320051 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f7d2735-b328-4764-a10b-31380ebc7c07 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:34.320563 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f7d2735-b328-4764-a10b-31380ebc7c07 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:34.321496 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f7d2735-b328-4764-a10b-31380ebc7c07 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:34.322510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f7d2735-b328-4764-a10b-31380ebc7c07 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:34.346675 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-175032b6-aed1-4341-bc6d-cd180de3e93b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:34.354977 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3f7d2735-b328-4764-a10b-31380ebc7c07 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048584 Jul 27 04:30:34.355536 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 387/764] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:30:34 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:30:34.355816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-175032b6-aed1-4341-bc6d-cd180de3e93b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.165389 Jul 27 04:30:34.356377 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 378/765] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:34 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:35.367304 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-cdb639c8-f98a-4831-85d2-fdd928df94dc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:35.369585 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-cdb639c8-f98a-4831-85d2-fdd928df94dc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:35.377011 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-c53c3b01-51f6-447d-b191-15b3e971824a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:35.377722 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-c53c3b01-51f6-447d-b191-15b3e971824a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:35.378149 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cdb639c8-f98a-4831-85d2-fdd928df94dc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:35.378604 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cdb639c8-f98a-4831-85d2-fdd928df94dc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:35.379382 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cdb639c8-f98a-4831-85d2-fdd928df94dc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:35.379819 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cdb639c8-f98a-4831-85d2-fdd928df94dc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:35.384476 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c53c3b01-51f6-447d-b191-15b3e971824a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:35.384922 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c53c3b01-51f6-447d-b191-15b3e971824a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:35.385683 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c53c3b01-51f6-447d-b191-15b3e971824a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:35.386224 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-c53c3b01-51f6-447d-b191-15b3e971824a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:35.410160 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-cdb639c8-f98a-4831-85d2-fdd928df94dc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046718 Jul 27 04:30:35.410759 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 388/766] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:30:35 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 04:30:35.480001 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4960a995-8f7c-4a08-bd50-dc5fb3cca3c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:35.480497 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4960a995-8f7c-4a08-bd50-dc5fb3cca3c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:35.487370 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4960a995-8f7c-4a08-bd50-dc5fb3cca3c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:35.487825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4960a995-8f7c-4a08-bd50-dc5fb3cca3c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:35.488603 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4960a995-8f7c-4a08-bd50-dc5fb3cca3c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:35.489039 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4960a995-8f7c-4a08-bd50-dc5fb3cca3c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:35.514309 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4960a995-8f7c-4a08-bd50-dc5fb3cca3c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Going to try to terminate instance {{(pid=117740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:30:35.540464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-c53c3b01-51f6-447d-b191-15b3e971824a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:35.549800 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-c53c3b01-51f6-447d-b191-15b3e971824a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.177166 Jul 27 04:30:35.552610 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 379/767] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:35 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:35.602185 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4960a995-8f7c-4a08-bd50-dc5fb3cca3c6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 204 len: 0 microversion: 2.1 time: 0.125502 Jul 27 04:30:35.603054 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 389/768] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:30:35 2022] DELETE /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 04:30:35.612028 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7e91828d-8578-495a-8e18-ef502bba427d tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:35.613097 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-7e91828d-8578-495a-8e18-ef502bba427d tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:35.619732 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7e91828d-8578-495a-8e18-ef502bba427d tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:35.620117 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7e91828d-8578-495a-8e18-ef502bba427d tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:35.621082 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7e91828d-8578-495a-8e18-ef502bba427d tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:35.621521 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7e91828d-8578-495a-8e18-ef502bba427d tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:35.757365 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-7e91828d-8578-495a-8e18-ef502bba427d tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:35.765273 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-7e91828d-8578-495a-8e18-ef502bba427d tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1681 microversion: 2.1 time: 0.157783 Jul 27 04:30:35.766386 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 380/769] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:35 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:30:36.573395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d1c5e575-3818-49ee-8d5d-d8f969e3df26 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:36.574124 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d1c5e575-3818-49ee-8d5d-d8f969e3df26 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:36.581440 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d1c5e575-3818-49ee-8d5d-d8f969e3df26 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:36.581892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d1c5e575-3818-49ee-8d5d-d8f969e3df26 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:36.582693 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d1c5e575-3818-49ee-8d5d-d8f969e3df26 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:36.583134 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d1c5e575-3818-49ee-8d5d-d8f969e3df26 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:36.721221 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d1c5e575-3818-49ee-8d5d-d8f969e3df26 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:36.729304 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d1c5e575-3818-49ee-8d5d-d8f969e3df26 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.160607 Jul 27 04:30:36.729859 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 390/770] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:36 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:36.789340 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-1ab626f9-5b42-4fb0-b4d9-1b1272bb2868 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:36.789960 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-1ab626f9-5b42-4fb0-b4d9-1b1272bb2868 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:36.798491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1ab626f9-5b42-4fb0-b4d9-1b1272bb2868 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:36.798943 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1ab626f9-5b42-4fb0-b4d9-1b1272bb2868 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:36.799731 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1ab626f9-5b42-4fb0-b4d9-1b1272bb2868 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:36.800176 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1ab626f9-5b42-4fb0-b4d9-1b1272bb2868 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:36.940857 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-1ab626f9-5b42-4fb0-b4d9-1b1272bb2868 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:36.949094 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-1ab626f9-5b42-4fb0-b4d9-1b1272bb2868 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1681 microversion: 2.1 time: 0.164001 Jul 27 04:30:36.949657 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 381/771] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:36 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:30:37.751654 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e5055f62-4dbb-438b-8162-3fe7187a4cea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:37.752269 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e5055f62-4dbb-438b-8162-3fe7187a4cea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:37.760764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e5055f62-4dbb-438b-8162-3fe7187a4cea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:37.761285 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e5055f62-4dbb-438b-8162-3fe7187a4cea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:37.762165 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e5055f62-4dbb-438b-8162-3fe7187a4cea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:37.762595 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e5055f62-4dbb-438b-8162-3fe7187a4cea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:37.930200 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e5055f62-4dbb-438b-8162-3fe7187a4cea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:37.941369 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e5055f62-4dbb-438b-8162-3fe7187a4cea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.194085 Jul 27 04:30:37.941936 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 391/772] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:37 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:37.972855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-fbd148f6-3a55-4410-a1e0-c1f8cb21feab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:37.973466 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-fbd148f6-3a55-4410-a1e0-c1f8cb21feab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:37.980505 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fbd148f6-3a55-4410-a1e0-c1f8cb21feab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:37.980948 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fbd148f6-3a55-4410-a1e0-c1f8cb21feab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:37.981740 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fbd148f6-3a55-4410-a1e0-c1f8cb21feab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:37.982402 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fbd148f6-3a55-4410-a1e0-c1f8cb21feab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:38.057086 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-fbd148f6-3a55-4410-a1e0-c1f8cb21feab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:38.065162 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-fbd148f6-3a55-4410-a1e0-c1f8cb21feab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1614 microversion: 2.1 time: 0.097240 Jul 27 04:30:38.065729 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 382/773] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:37 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:38.220085 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-46395781-99ef-4797-a592-186fdb74c6d5 req-3ce5555e-2141-42a1-82a5-41152d92de0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "995a6cca-8a06-4a14-9825-6961ef0a7785", "name": "network-vif-deleted", "tag": "916e92c2-3bae-413e-9dd4-35df32b29160"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:30:38.231872 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-46395781-99ef-4797-a592-186fdb74c6d5 req-3ce5555e-2141-42a1-82a5-41152d92de0a service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:38.234404 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-46395781-99ef-4797-a592-186fdb74c6d5 req-3ce5555e-2141-42a1-82a5-41152d92de0a service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:38.259112 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-46395781-99ef-4797-a592-186fdb74c6d5 req-3ce5555e-2141-42a1-82a5-41152d92de0a service nova] Creating event network-vif-deleted:916e92c2-3bae-413e-9dd4-35df32b29160 for instance 995a6cca-8a06-4a14-9825-6961ef0a7785 on hv-cinder-85098 Jul 27 04:30:38.266836 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-46395781-99ef-4797-a592-186fdb74c6d5 req-3ce5555e-2141-42a1-82a5-41152d92de0a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050826 Jul 27 04:30:38.268980 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 392/774] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:38.963049 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ae5bb926-6d6a-423d-8447-818074908376 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:38.963901 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ae5bb926-6d6a-423d-8447-818074908376 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:38.971980 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ae5bb926-6d6a-423d-8447-818074908376 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:38.972656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ae5bb926-6d6a-423d-8447-818074908376 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:38.973779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ae5bb926-6d6a-423d-8447-818074908376 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:38.975485 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ae5bb926-6d6a-423d-8447-818074908376 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:39.096096 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e3aa89f7-84d6-4ad1-b125-ff5c91406e55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:39.097769 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e3aa89f7-84d6-4ad1-b125-ff5c91406e55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:39.106025 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e3aa89f7-84d6-4ad1-b125-ff5c91406e55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:39.106718 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e3aa89f7-84d6-4ad1-b125-ff5c91406e55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:39.107839 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e3aa89f7-84d6-4ad1-b125-ff5c91406e55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:39.108575 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e3aa89f7-84d6-4ad1-b125-ff5c91406e55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:39.157269 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e3aa89f7-84d6-4ad1-b125-ff5c91406e55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:39.157960 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e3aa89f7-84d6-4ad1-b125-ff5c91406e55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:39.158765 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-e3aa89f7-84d6-4ad1-b125-ff5c91406e55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lazy-loading 'fault' on Instance uuid 995a6cca-8a06-4a14-9825-6961ef0a7785 {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:30:39.173584 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ae5bb926-6d6a-423d-8447-818074908376 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:39.197810 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ae5bb926-6d6a-423d-8447-818074908376 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.238297 Jul 27 04:30:39.198734 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 383/775] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:38 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:39.211614 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e3aa89f7-84d6-4ad1-b125-ff5c91406e55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:39.221304 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e3aa89f7-84d6-4ad1-b125-ff5c91406e55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 200 len: 1331 microversion: 2.1 time: 0.136675 Jul 27 04:30:39.222154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 393/776] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:39 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 1331 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:30:40.221030 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-94cdd6c8-b1a8-4cdb-b563-492ca081cd27 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:40.221666 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-94cdd6c8-b1a8-4cdb-b563-492ca081cd27 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:40.228224 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-94cdd6c8-b1a8-4cdb-b563-492ca081cd27 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:40.228667 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-94cdd6c8-b1a8-4cdb-b563-492ca081cd27 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:40.229423 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-94cdd6c8-b1a8-4cdb-b563-492ca081cd27 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:40.230051 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-94cdd6c8-b1a8-4cdb-b563-492ca081cd27 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:40.243199 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d174d34a-ccd5-4220-8b5d-63eff7803c9b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:40.243809 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d174d34a-ccd5-4220-8b5d-63eff7803c9b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:40.251147 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d174d34a-ccd5-4220-8b5d-63eff7803c9b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:40.251614 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d174d34a-ccd5-4220-8b5d-63eff7803c9b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:40.252437 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d174d34a-ccd5-4220-8b5d-63eff7803c9b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:40.252874 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d174d34a-ccd5-4220-8b5d-63eff7803c9b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:40.267289 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-d174d34a-ccd5-4220-8b5d-63eff7803c9b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d174d34a-ccd5-4220-8b5d-63eff7803c9b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 HTTP/1.1 Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:30:40.268935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:30:40.270314 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:30:40.270314 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:30:40.270314 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:30:40.270314 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:30:40.270314 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:30:40.270314 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:30:40.270314 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:30:40.270314 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:30:40.270314 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:30:40.270314 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:30:40.270314 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:30:40.270314 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '995a6cca-8a06-4a14-9825-6961ef0a7785'} Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:30:40.271088 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:30:40.272345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:30:40.273516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d174d34a-ccd5-4220-8b5d-63eff7803c9b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 404 to user: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:30:40.273516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d174d34a-ccd5-4220-8b5d-63eff7803c9b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 404 len: 111 microversion: 2.1 time: 0.030975 Jul 27 04:30:40.282057 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 394/777] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:40 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 04:30:40.282057 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-18043e5c-e7d1-4e5f-80d3-28979f9983bd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '.version_select at 0x7f21d5a8eee0>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:40.301889 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-18043e5c-e7d1-4e5f-80d3-28979f9983bd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241339738" status: 202 len: 0 microversion: 2.1 time: 0.025815 Jul 27 04:30:40.301889 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 395/778] 10.222.0.46 () {58 vars in 1221 bytes} [Wed Jul 27 04:30:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241339738 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:30:40.375326 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-94cdd6c8-b1a8-4cdb-b563-492ca081cd27 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:40.385859 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-94cdd6c8-b1a8-4cdb-b563-492ca081cd27 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.168898 Jul 27 04:30:40.386904 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 384/779] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:40 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:40.943039 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ae60b685-57ce-42bf-a85c-f6e7c0afcf4e tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Action: 'create', calling method: .version_select at 0x7f21d5ace9d0>, body: {"keypair": {"name": "tempest-keypair-796274630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5FxaVMaBCT2Z8ilLplXEApTYuETqzC0KnlvdsH/THqWdZVZMpTefuAilNTb8nLHTdTkOdmflMpx3UgToeqLGKUcL/u2OH9jJeQ6Z4MC1xKdcyG59RFyNpubKsw1RPBhw=="}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:30:40.962754 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-ae60b685-57ce-42bf-a85c-f6e7c0afcf4e tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for project aa51c6088dfa44df848e339d61bac664. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:30:40.966971 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-ae60b685-57ce-42bf-a85c-f6e7c0afcf4e tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for user 8cbc27f4433e4c48a75b216540a9022f and project aa51c6088dfa44df848e339d61bac664. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:30:40.990854 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ae60b685-57ce-42bf-a85c-f6e7c0afcf4e tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051665 Jul 27 04:30:40.991452 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 396/780] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Jul 27 04:30:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:41.408711 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9274f81a-b736-405d-8207-69fc6e59af0b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:41.409354 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9274f81a-b736-405d-8207-69fc6e59af0b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:41.420243 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9274f81a-b736-405d-8207-69fc6e59af0b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:41.420697 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9274f81a-b736-405d-8207-69fc6e59af0b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:41.421954 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9274f81a-b736-405d-8207-69fc6e59af0b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:41.424387 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9274f81a-b736-405d-8207-69fc6e59af0b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:41.428799 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:30:41.648051 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9274f81a-b736-405d-8207-69fc6e59af0b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:41.656420 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9274f81a-b736-405d-8207-69fc6e59af0b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.252216 Jul 27 04:30:41.659209 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 385/781] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:41 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:42.599498 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-204266496", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7941c677-84e1-4370-9083-08b3d22ae50b"}], "security_groups": [{"name": "tempest-securitygroup--406406834"}], "key_name": "tempest-keypair-796274630", "user_data": "}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:30:42.680341 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-17c70504-0c9b-4917-8b1a-e4955ecee845 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:42.681045 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-17c70504-0c9b-4917-8b1a-e4955ecee845 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:42.687626 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-17c70504-0c9b-4917-8b1a-e4955ecee845 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:42.688172 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-17c70504-0c9b-4917-8b1a-e4955ecee845 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:42.689018 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-17c70504-0c9b-4917-8b1a-e4955ecee845 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:42.689662 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-17c70504-0c9b-4917-8b1a-e4955ecee845 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:42.708726 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.network.neutron [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] validate_networks() for [('7941c677-84e1-4370-9083-08b3d22ae50b', None, None, None, None, None)] {{(pid=117740) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:30:42.831918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-17c70504-0c9b-4917-8b1a-e4955ecee845 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:42.849782 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-17c70504-0c9b-4917-8b1a-e4955ecee845 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.173157 Jul 27 04:30:42.850578 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 386/782] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:42 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:43.112408 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Flavor limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:30:43.112833 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Image limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:30:43.113319 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Flavor pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:30:43.113728 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Image pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:30:43.114167 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:30:43.122932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:43.123415 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:43.124213 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:43.124717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:43.141613 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for project aa51c6088dfa44df848e339d61bac664. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:30:43.145542 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Getting quotas for user 8cbc27f4433e4c48a75b216540a9022f and project aa51c6088dfa44df848e339d61bac664. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:30:43.157004 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Going to run 1 instances... {{(pid=117740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:30:43.159285 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:30:43.207127 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-5e394339-a491-409f-8968-6c2ed1910bf4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.613500 Jul 27 04:30:43.207769 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 397/783] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:30:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:30:43.219478 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f8a8a11a-a039-4fd3-9e7a-bbcd95ca7796 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:43.220441 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f8a8a11a-a039-4fd3-9e7a-bbcd95ca7796 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:43.274879 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f8a8a11a-a039-4fd3-9e7a-bbcd95ca7796 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:43.281740 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f8a8a11a-a039-4fd3-9e7a-bbcd95ca7796 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 200 len: 1240 microversion: 2.1 time: 0.066997 Jul 27 04:30:43.282355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 387/784] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:43 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:30:43.871291 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3f233edd-8bc4-4fc2-948f-807d1cf71c7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:43.871902 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3f233edd-8bc4-4fc2-948f-807d1cf71c7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:43.879032 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f233edd-8bc4-4fc2-948f-807d1cf71c7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:43.879472 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f233edd-8bc4-4fc2-948f-807d1cf71c7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:43.880225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f233edd-8bc4-4fc2-948f-807d1cf71c7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:43.880654 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3f233edd-8bc4-4fc2-948f-807d1cf71c7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:43.884591 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:30:44.009512 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3f233edd-8bc4-4fc2-948f-807d1cf71c7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:44.018368 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3f233edd-8bc4-4fc2-948f-807d1cf71c7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.151444 Jul 27 04:30:44.018939 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 398/785] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:43 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:44.302983 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3cd0d8fa-5de9-4077-823c-9eda9fc5a4ef tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:44.303594 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-3cd0d8fa-5de9-4077-823c-9eda9fc5a4ef tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:44.310649 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3cd0d8fa-5de9-4077-823c-9eda9fc5a4ef tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:44.311107 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3cd0d8fa-5de9-4077-823c-9eda9fc5a4ef tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:44.311887 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3cd0d8fa-5de9-4077-823c-9eda9fc5a4ef tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:44.312375 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3cd0d8fa-5de9-4077-823c-9eda9fc5a4ef tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:44.388062 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-3cd0d8fa-5de9-4077-823c-9eda9fc5a4ef tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:44.396106 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-3cd0d8fa-5de9-4077-823c-9eda9fc5a4ef tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 200 len: 1298 microversion: 2.1 time: 0.096757 Jul 27 04:30:44.397719 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 388/786] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:44 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:45.040962 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ab1dbdbb-4e50-405c-bbab-3691bcd29cd0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:45.041690 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ab1dbdbb-4e50-405c-bbab-3691bcd29cd0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:45.048936 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ab1dbdbb-4e50-405c-bbab-3691bcd29cd0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:45.049677 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ab1dbdbb-4e50-405c-bbab-3691bcd29cd0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:45.050661 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ab1dbdbb-4e50-405c-bbab-3691bcd29cd0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:45.051114 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ab1dbdbb-4e50-405c-bbab-3691bcd29cd0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:45.190924 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ab1dbdbb-4e50-405c-bbab-3691bcd29cd0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:45.199442 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ab1dbdbb-4e50-405c-bbab-3691bcd29cd0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.162913 Jul 27 04:30:45.200008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 399/787] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:45 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:45.418655 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0774ce61-4ff7-4ae1-a27a-f5292545bc7b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:45.419274 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0774ce61-4ff7-4ae1-a27a-f5292545bc7b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:45.426565 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0774ce61-4ff7-4ae1-a27a-f5292545bc7b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:45.427016 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0774ce61-4ff7-4ae1-a27a-f5292545bc7b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:45.427843 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0774ce61-4ff7-4ae1-a27a-f5292545bc7b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:45.428297 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0774ce61-4ff7-4ae1-a27a-f5292545bc7b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:45.553293 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-17573188-3fdb-42aa-9956-b2c1298bb6bd req-22c9a1b4-5608-49b6-9cc6-507bae2cd95d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54855bde-7670-4dc8-8f13-818e831e5f0b", "tag": "6a98180b-60a8-4f68-9bc5-865099b842ef"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:30:45.585077 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-17573188-3fdb-42aa-9956-b2c1298bb6bd req-22c9a1b4-5608-49b6-9cc6-507bae2cd95d service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:45.586824 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-17573188-3fdb-42aa-9956-b2c1298bb6bd req-22c9a1b4-5608-49b6-9cc6-507bae2cd95d service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:45.600100 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-17573188-3fdb-42aa-9956-b2c1298bb6bd req-22c9a1b4-5608-49b6-9cc6-507bae2cd95d service nova] Creating event network-changed:6a98180b-60a8-4f68-9bc5-865099b842ef for instance 54855bde-7670-4dc8-8f13-818e831e5f0b on hv-cinder-85098 Jul 27 04:30:45.605587 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-17573188-3fdb-42aa-9956-b2c1298bb6bd req-22c9a1b4-5608-49b6-9cc6-507bae2cd95d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060673 Jul 27 04:30:45.606932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 400/788] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:45.659806 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-0774ce61-4ff7-4ae1-a27a-f5292545bc7b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:45.667687 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0774ce61-4ff7-4ae1-a27a-f5292545bc7b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 200 len: 1365 microversion: 2.1 time: 0.252879 Jul 27 04:30:45.668301 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 389/789] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:45 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:46.223358 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-700a4cea-1969-4ae8-9356-84213f2f6f84 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:46.224053 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-700a4cea-1969-4ae8-9356-84213f2f6f84 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:46.230198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-700a4cea-1969-4ae8-9356-84213f2f6f84 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:46.230651 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-700a4cea-1969-4ae8-9356-84213f2f6f84 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:46.231406 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-700a4cea-1969-4ae8-9356-84213f2f6f84 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:46.231843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-700a4cea-1969-4ae8-9356-84213f2f6f84 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:46.365025 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-700a4cea-1969-4ae8-9356-84213f2f6f84 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:46.372861 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-700a4cea-1969-4ae8-9356-84213f2f6f84 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.154520 Jul 27 04:30:46.373451 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 401/790] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:46 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:46.689457 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-28d9ae32-1a09-41d7-a5f0-3354042eb91a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:46.690101 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-28d9ae32-1a09-41d7-a5f0-3354042eb91a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:46.696697 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-28d9ae32-1a09-41d7-a5f0-3354042eb91a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:46.697144 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-28d9ae32-1a09-41d7-a5f0-3354042eb91a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:46.698212 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-28d9ae32-1a09-41d7-a5f0-3354042eb91a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:46.698678 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-28d9ae32-1a09-41d7-a5f0-3354042eb91a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:46.923560 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-28d9ae32-1a09-41d7-a5f0-3354042eb91a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:46.930916 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-28d9ae32-1a09-41d7-a5f0-3354042eb91a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 200 len: 1365 microversion: 2.1 time: 0.246177 Jul 27 04:30:46.931488 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 390/791] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:46 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:47.395493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7f5776b3-a9fb-477c-b117-0c1d0a6e7ea1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:47.396101 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-7f5776b3-a9fb-477c-b117-0c1d0a6e7ea1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:47.402464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7f5776b3-a9fb-477c-b117-0c1d0a6e7ea1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:47.402907 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7f5776b3-a9fb-477c-b117-0c1d0a6e7ea1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:47.403663 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7f5776b3-a9fb-477c-b117-0c1d0a6e7ea1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:47.404092 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7f5776b3-a9fb-477c-b117-0c1d0a6e7ea1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:47.530648 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-7f5776b3-a9fb-477c-b117-0c1d0a6e7ea1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:47.539206 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-7f5776b3-a9fb-477c-b117-0c1d0a6e7ea1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.147607 Jul 27 04:30:47.539771 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 402/792] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:47 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:47.951468 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4ff777af-fa22-47a0-bcf6-88905285a317 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:47.952078 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4ff777af-fa22-47a0-bcf6-88905285a317 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:47.959552 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4ff777af-fa22-47a0-bcf6-88905285a317 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:47.959993 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4ff777af-fa22-47a0-bcf6-88905285a317 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:47.960754 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4ff777af-fa22-47a0-bcf6-88905285a317 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:47.961188 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4ff777af-fa22-47a0-bcf6-88905285a317 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:48.094468 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4ff777af-fa22-47a0-bcf6-88905285a317 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:48.101765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4ff777af-fa22-47a0-bcf6-88905285a317 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 200 len: 1365 microversion: 2.1 time: 0.154360 Jul 27 04:30:48.102359 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 391/793] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:47 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:48.560670 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-438a6035-f682-48aa-a8d4-36b0ba37752e tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:48.561383 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-438a6035-f682-48aa-a8d4-36b0ba37752e tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:48.568452 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-438a6035-f682-48aa-a8d4-36b0ba37752e tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:48.568908 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-438a6035-f682-48aa-a8d4-36b0ba37752e tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:48.569683 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-438a6035-f682-48aa-a8d4-36b0ba37752e tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:48.570152 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-438a6035-f682-48aa-a8d4-36b0ba37752e tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:48.701354 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-438a6035-f682-48aa-a8d4-36b0ba37752e tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:48.709730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-438a6035-f682-48aa-a8d4-36b0ba37752e tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.152991 Jul 27 04:30:48.710329 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 403/794] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:48 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:49.122473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-289ddac3-0f00-4230-a83e-207178a5a149 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:49.122991 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-289ddac3-0f00-4230-a83e-207178a5a149 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:49.130167 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-289ddac3-0f00-4230-a83e-207178a5a149 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:49.130616 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-289ddac3-0f00-4230-a83e-207178a5a149 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:49.131383 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-289ddac3-0f00-4230-a83e-207178a5a149 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:49.131817 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-289ddac3-0f00-4230-a83e-207178a5a149 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:49.259540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-289ddac3-0f00-4230-a83e-207178a5a149 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:49.267041 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-289ddac3-0f00-4230-a83e-207178a5a149 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 200 len: 1365 microversion: 2.1 time: 0.148511 Jul 27 04:30:49.267629 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 392/795] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:49 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:49.732150 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d025cc55-ff7e-45f4-8e68-5abe21d11be5 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:49.732719 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d025cc55-ff7e-45f4-8e68-5abe21d11be5 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:49.735920 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:30:49.741026 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d025cc55-ff7e-45f4-8e68-5abe21d11be5 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:49.741473 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d025cc55-ff7e-45f4-8e68-5abe21d11be5 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:49.742273 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d025cc55-ff7e-45f4-8e68-5abe21d11be5 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:49.742713 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d025cc55-ff7e-45f4-8e68-5abe21d11be5 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:49.872484 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d025cc55-ff7e-45f4-8e68-5abe21d11be5 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:49.880901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d025cc55-ff7e-45f4-8e68-5abe21d11be5 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.152733 Jul 27 04:30:49.881465 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 404/796] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:49 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:50.242233 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-ee918197-edb2-42d1-9353-24e7be029293 req-45f0c35b-dde8-4e05-803c-49022bdc8a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54855bde-7670-4dc8-8f13-818e831e5f0b", "name": "network-vif-plugged", "status": "completed", "tag": "6a98180b-60a8-4f68-9bc5-865099b842ef"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:30:50.253326 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-ee918197-edb2-42d1-9353-24e7be029293 req-45f0c35b-dde8-4e05-803c-49022bdc8a05 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:50.254237 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-ee918197-edb2-42d1-9353-24e7be029293 req-45f0c35b-dde8-4e05-803c-49022bdc8a05 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:50.265921 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-ee918197-edb2-42d1-9353-24e7be029293 req-45f0c35b-dde8-4e05-803c-49022bdc8a05 service nova] Creating event network-vif-plugged:6a98180b-60a8-4f68-9bc5-865099b842ef for instance 54855bde-7670-4dc8-8f13-818e831e5f0b on hv-cinder-85098 Jul 27 04:30:50.271828 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-ee918197-edb2-42d1-9353-24e7be029293 req-45f0c35b-dde8-4e05-803c-49022bdc8a05 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033374 Jul 27 04:30:50.272606 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 393/797] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:50.289011 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0406c494-b0ad-4529-baaf-59bf37279580 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:50.289011 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0406c494-b0ad-4529-baaf-59bf37279580 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:50.305513 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0406c494-b0ad-4529-baaf-59bf37279580 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:50.305990 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0406c494-b0ad-4529-baaf-59bf37279580 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:50.306782 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0406c494-b0ad-4529-baaf-59bf37279580 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:50.308621 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0406c494-b0ad-4529-baaf-59bf37279580 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:50.446823 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0406c494-b0ad-4529-baaf-59bf37279580 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:50.454718 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0406c494-b0ad-4529-baaf-59bf37279580 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 200 len: 1365 microversion: 2.1 time: 0.170297 Jul 27 04:30:50.455491 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 405/798] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:50 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:50.903060 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f95deadf-30c8-429e-91fd-001488e0c2ab tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:50.903773 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f95deadf-30c8-429e-91fd-001488e0c2ab tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:50.910765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f95deadf-30c8-429e-91fd-001488e0c2ab tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:50.911207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f95deadf-30c8-429e-91fd-001488e0c2ab tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:50.911959 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f95deadf-30c8-429e-91fd-001488e0c2ab tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:50.912390 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f95deadf-30c8-429e-91fd-001488e0c2ab tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:51.040716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f95deadf-30c8-429e-91fd-001488e0c2ab tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:51.049246 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f95deadf-30c8-429e-91fd-001488e0c2ab tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.150370 Jul 27 04:30:51.049816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 394/799] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:50 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:51.476103 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8b9ba51f-65df-4eb6-8098-910d988d2afc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:51.476708 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-8b9ba51f-65df-4eb6-8098-910d988d2afc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:51.483185 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8b9ba51f-65df-4eb6-8098-910d988d2afc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:51.483629 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8b9ba51f-65df-4eb6-8098-910d988d2afc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:51.484380 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8b9ba51f-65df-4eb6-8098-910d988d2afc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:51.484803 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8b9ba51f-65df-4eb6-8098-910d988d2afc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:51.612501 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-8b9ba51f-65df-4eb6-8098-910d988d2afc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:51.619806 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8b9ba51f-65df-4eb6-8098-910d988d2afc tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 200 len: 1365 microversion: 2.1 time: 0.147670 Jul 27 04:30:51.620374 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 406/800] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:51 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:52.070329 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-838287c3-9b0f-49fe-8c98-be84c390c55c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:52.070847 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-838287c3-9b0f-49fe-8c98-be84c390c55c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:52.073550 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=49 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:30:52.078896 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-838287c3-9b0f-49fe-8c98-be84c390c55c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:52.079247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-838287c3-9b0f-49fe-8c98-be84c390c55c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:52.080025 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-838287c3-9b0f-49fe-8c98-be84c390c55c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:52.080570 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-838287c3-9b0f-49fe-8c98-be84c390c55c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:52.216622 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-838287c3-9b0f-49fe-8c98-be84c390c55c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:52.225188 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-838287c3-9b0f-49fe-8c98-be84c390c55c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.158817 Jul 27 04:30:52.225747 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 395/801] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:52 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:52.640406 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-54700997-5989-4be9-910c-25e7dd3f84ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:52.641013 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-54700997-5989-4be9-910c-25e7dd3f84ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:52.648030 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-54700997-5989-4be9-910c-25e7dd3f84ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:52.648470 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-54700997-5989-4be9-910c-25e7dd3f84ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:52.649222 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-54700997-5989-4be9-910c-25e7dd3f84ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:52.649648 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-54700997-5989-4be9-910c-25e7dd3f84ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:52.779870 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-54700997-5989-4be9-910c-25e7dd3f84ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:52.787955 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-54700997-5989-4be9-910c-25e7dd3f84ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 200 len: 1555 microversion: 2.1 time: 0.151375 Jul 27 04:30:52.788521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 407/802] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:52 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:52.809783 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ed7a178a-1517-45f2-940d-402f1d51619a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:52.810310 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ed7a178a-1517-45f2-940d-402f1d51619a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:52.816940 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ed7a178a-1517-45f2-940d-402f1d51619a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:52.817389 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ed7a178a-1517-45f2-940d-402f1d51619a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:52.818209 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ed7a178a-1517-45f2-940d-402f1d51619a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:52.818647 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ed7a178a-1517-45f2-940d-402f1d51619a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:52.899246 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ed7a178a-1517-45f2-940d-402f1d51619a tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093376 Jul 27 04:30:52.899854 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 396/803] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Jul 27 04:30:52 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:53.246617 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ec0453ac-c6d2-49c3-8bc6-c2083ca5bce2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:53.247228 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ec0453ac-c6d2-49c3-8bc6-c2083ca5bce2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:53.250135 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:30:53.251409 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=10 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:30:53.254945 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ec0453ac-c6d2-49c3-8bc6-c2083ca5bce2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:53.255395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ec0453ac-c6d2-49c3-8bc6-c2083ca5bce2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:53.256162 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ec0453ac-c6d2-49c3-8bc6-c2083ca5bce2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:53.256594 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ec0453ac-c6d2-49c3-8bc6-c2083ca5bce2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:53.388185 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ec0453ac-c6d2-49c3-8bc6-c2083ca5bce2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:53.396720 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ec0453ac-c6d2-49c3-8bc6-c2083ca5bce2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.153857 Jul 27 04:30:53.397292 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 408/804] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:53 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:53.820033 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:30:53.824299 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-4a1913c1-34e2-4a87-9b86-0f109c5a1c55 req-9201bde5-7bf9-42cd-953c-8c4c7707b907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54855bde-7670-4dc8-8f13-818e831e5f0b", "tag": "6a98180b-60a8-4f68-9bc5-865099b842ef"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:30:53.834546 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-4a1913c1-34e2-4a87-9b86-0f109c5a1c55 req-9201bde5-7bf9-42cd-953c-8c4c7707b907 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:53.835064 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-4a1913c1-34e2-4a87-9b86-0f109c5a1c55 req-9201bde5-7bf9-42cd-953c-8c4c7707b907 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:53.846779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-4a1913c1-34e2-4a87-9b86-0f109c5a1c55 req-9201bde5-7bf9-42cd-953c-8c4c7707b907 service nova] Creating event network-changed:6a98180b-60a8-4f68-9bc5-865099b842ef for instance 54855bde-7670-4dc8-8f13-818e831e5f0b on hv-cinder-85098 Jul 27 04:30:53.851601 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-4a1913c1-34e2-4a87-9b86-0f109c5a1c55 req-9201bde5-7bf9-42cd-953c-8c4c7707b907 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032571 Jul 27 04:30:53.852387 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 397/805] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:30:54.418452 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-725896df-16cb-431f-8e30-5ce35aa29d33 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:54.419476 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-725896df-16cb-431f-8e30-5ce35aa29d33 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:54.426642 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-725896df-16cb-431f-8e30-5ce35aa29d33 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:54.427383 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-725896df-16cb-431f-8e30-5ce35aa29d33 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:54.428174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-725896df-16cb-431f-8e30-5ce35aa29d33 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:54.428621 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-725896df-16cb-431f-8e30-5ce35aa29d33 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:54.590811 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-725896df-16cb-431f-8e30-5ce35aa29d33 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:54.602821 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-725896df-16cb-431f-8e30-5ce35aa29d33 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1717 microversion: 2.1 time: 0.188362 Jul 27 04:30:54.608038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 409/806] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:54 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1717 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:55.627137 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4764a68a-68fb-49ee-af51-6baf23d3bf40 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:55.627748 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4764a68a-68fb-49ee-af51-6baf23d3bf40 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:55.633854 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4764a68a-68fb-49ee-af51-6baf23d3bf40 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:55.634328 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4764a68a-68fb-49ee-af51-6baf23d3bf40 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:55.635088 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4764a68a-68fb-49ee-af51-6baf23d3bf40 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:55.635521 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4764a68a-68fb-49ee-af51-6baf23d3bf40 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:55.762770 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4764a68a-68fb-49ee-af51-6baf23d3bf40 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:55.771309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4764a68a-68fb-49ee-af51-6baf23d3bf40 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1694 microversion: 2.1 time: 0.149595 Jul 27 04:30:55.771873 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 398/807] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:55 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1694 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:55.792047 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1b53d448-b13a-4100-acb6-2d1114dcc348 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:30:55.798513 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1b53d448-b13a-4100-acb6-2d1114dcc348 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:55.798955 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1b53d448-b13a-4100-acb6-2d1114dcc348 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:55.821150 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-1b53d448-b13a-4100-acb6-2d1114dcc348 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Going to try to start instance {{(pid=117740) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 27 04:30:55.863829 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-1b53d448-b13a-4100-acb6-2d1114dcc348 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "POST /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/action" status: 202 len: 0 microversion: 2.1 time: 0.075255 Jul 27 04:30:55.865196 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 410/808] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:30:55 2022] POST /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:30:55.877240 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8a90e832-f453-4221-a7a7-60b6b459eb0a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:55.877786 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8a90e832-f453-4221-a7a7-60b6b459eb0a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:55.884994 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8a90e832-f453-4221-a7a7-60b6b459eb0a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:55.885846 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8a90e832-f453-4221-a7a7-60b6b459eb0a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:55.886661 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8a90e832-f453-4221-a7a7-60b6b459eb0a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:55.887105 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8a90e832-f453-4221-a7a7-60b6b459eb0a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:56.069856 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8a90e832-f453-4221-a7a7-60b6b459eb0a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:56.078248 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8a90e832-f453-4221-a7a7-60b6b459eb0a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1703 microversion: 2.1 time: 0.208473 Jul 27 04:30:56.078860 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 399/809] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:55 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1703 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:57.100048 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8aace639-a015-4b47-abb3-32f9b80a1401 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:57.100718 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-8aace639-a015-4b47-abb3-32f9b80a1401 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:57.107399 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8aace639-a015-4b47-abb3-32f9b80a1401 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:57.107950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8aace639-a015-4b47-abb3-32f9b80a1401 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:57.108718 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8aace639-a015-4b47-abb3-32f9b80a1401 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:57.109151 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8aace639-a015-4b47-abb3-32f9b80a1401 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:57.241946 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-8aace639-a015-4b47-abb3-32f9b80a1401 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:57.249800 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8aace639-a015-4b47-abb3-32f9b80a1401 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1703 microversion: 2.1 time: 0.154177 Jul 27 04:30:57.250396 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 411/810] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:57 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1703 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:30:58.271631 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b3b40028-13c1-4426-8b4f-f56697d4b5ae tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:30:58.272229 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-b3b40028-13c1-4426-8b4f-f56697d4b5ae tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:30:58.278799 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b3b40028-13c1-4426-8b4f-f56697d4b5ae tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:58.279247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b3b40028-13c1-4426-8b4f-f56697d4b5ae tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:58.280007 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b3b40028-13c1-4426-8b4f-f56697d4b5ae tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:30:58.280442 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b3b40028-13c1-4426-8b4f-f56697d4b5ae tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:30:58.410330 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-b3b40028-13c1-4426-8b4f-f56697d4b5ae tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:30:58.418221 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-b3b40028-13c1-4426-8b4f-f56697d4b5ae tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1707 microversion: 2.1 time: 0.150427 Jul 27 04:30:58.418787 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 400/811] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:30:58 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1707 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:21.493458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=15 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:31:21.494669 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:31:21.498739 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8ca7f8da-3ee7-4d7f-893b-ccb56cb1f2b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:21.499319 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-8ca7f8da-3ee7-4d7f-893b-ccb56cb1f2b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:21.500493 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-bda501b1-87a7-4ee8-b626-06d32d80cd2d req-2a8a76d1-32f3-4dbd-b92b-d8f43cda5831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e57f119-e51a-48e1-a962-88581d0864fa", "tag": "3800c112-02a8-4dbf-838b-dd08425bca2f"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:31:21.507975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8ca7f8da-3ee7-4d7f-893b-ccb56cb1f2b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:21.507975 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8ca7f8da-3ee7-4d7f-893b-ccb56cb1f2b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:21.508276 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=11 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:31:21.508572 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8ca7f8da-3ee7-4d7f-893b-ccb56cb1f2b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:21.508685 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=78 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:31:21.508973 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-8ca7f8da-3ee7-4d7f-893b-ccb56cb1f2b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:21.513047 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-bda501b1-87a7-4ee8-b626-06d32d80cd2d req-2a8a76d1-32f3-4dbd-b92b-d8f43cda5831 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:21.513556 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-bda501b1-87a7-4ee8-b626-06d32d80cd2d req-2a8a76d1-32f3-4dbd-b92b-d8f43cda5831 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:21.529672 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-bda501b1-87a7-4ee8-b626-06d32d80cd2d req-2a8a76d1-32f3-4dbd-b92b-d8f43cda5831 service nova] Creating event network-changed:3800c112-02a8-4dbf-838b-dd08425bca2f for instance 3e57f119-e51a-48e1-a962-88581d0864fa on hv-cinder-85098 Jul 27 04:31:21.536740 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-bda501b1-87a7-4ee8-b626-06d32d80cd2d req-2a8a76d1-32f3-4dbd-b92b-d8f43cda5831 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040602 Jul 27 04:31:21.537609 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-8ca7f8da-3ee7-4d7f-893b-ccb56cb1f2b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Going to try to terminate instance {{(pid=117740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:31:21.538153 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 401/812] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:31:21.626790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8ca7f8da-3ee7-4d7f-893b-ccb56cb1f2b9 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 204 len: 0 microversion: 2.1 time: 0.131215 Jul 27 04:31:21.630596 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 412/813] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:31:21 2022] DELETE /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 04:31:21.636765 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8acc2d64-bc7b-4dcf-8a47-3bc0c826b76c tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:21.637638 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8acc2d64-bc7b-4dcf-8a47-3bc0c826b76c tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:21.644945 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8acc2d64-bc7b-4dcf-8a47-3bc0c826b76c tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:21.645524 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8acc2d64-bc7b-4dcf-8a47-3bc0c826b76c tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:21.646445 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8acc2d64-bc7b-4dcf-8a47-3bc0c826b76c tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:21.646929 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8acc2d64-bc7b-4dcf-8a47-3bc0c826b76c tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:21.804553 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8acc2d64-bc7b-4dcf-8a47-3bc0c826b76c tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:21.812181 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8acc2d64-bc7b-4dcf-8a47-3bc0c826b76c tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1577 microversion: 2.1 time: 0.179845 Jul 27 04:31:21.812757 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 402/814] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:21 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:31:22.836463 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-2d08f6aa-8ea7-4acd-8fc8-39bb9c2bcbe0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:22.837163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-2d08f6aa-8ea7-4acd-8fc8-39bb9c2bcbe0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:22.843574 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2d08f6aa-8ea7-4acd-8fc8-39bb9c2bcbe0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:22.844025 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2d08f6aa-8ea7-4acd-8fc8-39bb9c2bcbe0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:22.844894 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2d08f6aa-8ea7-4acd-8fc8-39bb9c2bcbe0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:22.845335 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2d08f6aa-8ea7-4acd-8fc8-39bb9c2bcbe0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:22.982248 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-2d08f6aa-8ea7-4acd-8fc8-39bb9c2bcbe0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:22.990563 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-2d08f6aa-8ea7-4acd-8fc8-39bb9c2bcbe0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1577 microversion: 2.1 time: 0.158343 Jul 27 04:31:22.991135 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 413/815] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:22 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:23.869353 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-92714ca3-18f8-4fc5-a913-0b4ee0dd2f74 req-3026de19-fe04-4b6a-be32-ba4ed5800972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e57f119-e51a-48e1-a962-88581d0864fa", "name": "network-vif-deleted", "tag": "3800c112-02a8-4dbf-838b-dd08425bca2f"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:31:23.880270 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-92714ca3-18f8-4fc5-a913-0b4ee0dd2f74 req-3026de19-fe04-4b6a-be32-ba4ed5800972 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:23.880756 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-92714ca3-18f8-4fc5-a913-0b4ee0dd2f74 req-3026de19-fe04-4b6a-be32-ba4ed5800972 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:23.896041 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-92714ca3-18f8-4fc5-a913-0b4ee0dd2f74 req-3026de19-fe04-4b6a-be32-ba4ed5800972 service nova] Creating event network-vif-deleted:3800c112-02a8-4dbf-838b-dd08425bca2f for instance 3e57f119-e51a-48e1-a962-88581d0864fa on hv-cinder-85098 Jul 27 04:31:23.900612 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-92714ca3-18f8-4fc5-a913-0b4ee0dd2f74 req-3026de19-fe04-4b6a-be32-ba4ed5800972 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034906 Jul 27 04:31:23.901202 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 403/816] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:31:24.011946 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-fd2a3ceb-9c92-4ffd-a2c9-9b96ed299af0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:24.012554 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-fd2a3ceb-9c92-4ffd-a2c9-9b96ed299af0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:24.020632 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fd2a3ceb-9c92-4ffd-a2c9-9b96ed299af0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:24.021099 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fd2a3ceb-9c92-4ffd-a2c9-9b96ed299af0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:24.021912 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fd2a3ceb-9c92-4ffd-a2c9-9b96ed299af0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:24.022334 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fd2a3ceb-9c92-4ffd-a2c9-9b96ed299af0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:24.086848 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-fd2a3ceb-9c92-4ffd-a2c9-9b96ed299af0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:24.094493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-fd2a3ceb-9c92-4ffd-a2c9-9b96ed299af0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 200 len: 1226 microversion: 2.1 time: 0.086270 Jul 27 04:31:24.095509 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 414/817] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:24 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:25.116164 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e32121a7-9e75-420b-973f-4bf4cd7a6409 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:25.116777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e32121a7-9e75-420b-973f-4bf4cd7a6409 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: 3e57f119-e51a-48e1-a962-88581d0864fa] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:25.122929 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e32121a7-9e75-420b-973f-4bf4cd7a6409 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:25.123373 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e32121a7-9e75-420b-973f-4bf4cd7a6409 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:25.124131 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e32121a7-9e75-420b-973f-4bf4cd7a6409 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:25.124564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e32121a7-9e75-420b-973f-4bf4cd7a6409 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:25.137619 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-e32121a7-9e75-420b-973f-4bf4cd7a6409 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] HTTP exception thrown: Instance 3e57f119-e51a-48e1-a962-88581d0864fa could not be found. Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e32121a7-9e75-420b-973f-4bf4cd7a6409 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Request method failure captured: Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa HTTP/1.1 Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L3hSmP2SOJhV3F-1jSFLV_MUh7OtRi5bPIi_AQ8z2gIQtYCReiWttEnQGEB0fYGbdTgL1YGHqTPw5NiZeSuQEe9b_vcpfkxtpsrP-j9J1SgbA2wnuBzLmLQNP9gkGZkTnxnq_EN5F3_0GmwApFpSw2qY8ByBk2Y3pbT38MPT_QQoEQ Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: 3825c2630a4f47e0b029bd0c90875108 Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-TestVolumeBootPattern-77715254 Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:31:25.139247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:31:25.140939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:31:25.140939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-TestVolumeBootPattern-77715254 Jul 27 04:31:25.140939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: 3825c2630a4f47e0b029bd0c90875108 Jul 27 04:31:25.140939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-TestVolumeBootPattern-77715254 Jul 27 04:31:25.140939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-TestVolumeBootPattern-77715254-project Jul 27 04:31:25.140939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:31:25.140939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:31:25.140939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: eea5b08eede4409484dc2f4305b5298a Jul 27 04:31:25.140939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-TestVolumeBootPattern-77715254-project Jul 27 04:31:25.140939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:31:25.140939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 3e57f119-e51a-48e1-a962-88581d0864fa could not be found. Jul 27 04:31:25.140939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '3e57f119-e51a-48e1-a962-88581d0864fa'} Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e57f119-e51a-48e1-a962-88581d0864fa could not be found. Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:31:25.142600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e57f119-e51a-48e1-a962-88581d0864fa could not be found. Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e57f119-e51a-48e1-a962-88581d0864fa could not be found. Jul 27 04:31:25.144141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:25.145535 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e32121a7-9e75-420b-973f-4bf4cd7a6409 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Returning 404 to user: Instance 3e57f119-e51a-48e1-a962-88581d0864fa could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:31:25.145535 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e32121a7-9e75-420b-973f-4bf4cd7a6409 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa" status: 404 len: 111 microversion: 2.1 time: 0.029224 Jul 27 04:31:25.145535 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 404/818] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:25 2022] GET /compute/v2.1/servers/3e57f119-e51a-48e1-a962-88581d0864fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:31:28.195035 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-893494cd-c259-42d9-a807-8eac1ae6fd04 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:28.195568 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-893494cd-c259-42d9-a807-8eac1ae6fd04 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:28.196840 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-710fa9ca-ee51-407b-8ddd-649e4dad921d req-6b9d0dc8-b914-4dd4-a094-551dcd9bb9dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebadd469-2167-427c-99e3-da0d244d3c43", "tag": "4df25964-f8b6-4580-9b35-69da892880e3"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:31:28.202392 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-893494cd-c259-42d9-a807-8eac1ae6fd04 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:28.203122 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-893494cd-c259-42d9-a807-8eac1ae6fd04 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:28.203908 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-893494cd-c259-42d9-a807-8eac1ae6fd04 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:28.204346 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-893494cd-c259-42d9-a807-8eac1ae6fd04 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:28.208358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-710fa9ca-ee51-407b-8ddd-649e4dad921d req-6b9d0dc8-b914-4dd4-a094-551dcd9bb9dd service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:28.208882 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-710fa9ca-ee51-407b-8ddd-649e4dad921d req-6b9d0dc8-b914-4dd4-a094-551dcd9bb9dd service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:28.220295 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-710fa9ca-ee51-407b-8ddd-649e4dad921d req-6b9d0dc8-b914-4dd4-a094-551dcd9bb9dd service nova] Creating event network-changed:4df25964-f8b6-4580-9b35-69da892880e3 for instance ebadd469-2167-427c-99e3-da0d244d3c43 on hv-cinder-85098 Jul 27 04:31:28.227691 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-710fa9ca-ee51-407b-8ddd-649e4dad921d req-6b9d0dc8-b914-4dd4-a094-551dcd9bb9dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034238 Jul 27 04:31:28.228809 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 405/819] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:31:28.234574 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-893494cd-c259-42d9-a807-8eac1ae6fd04 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Going to try to terminate instance {{(pid=117740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:31:28.328141 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-893494cd-c259-42d9-a807-8eac1ae6fd04 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 204 len: 0 microversion: 2.1 time: 0.136777 Jul 27 04:31:28.332882 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 415/820] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:31:28 2022] DELETE /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:31:28.338590 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f425d510-8f15-4422-835c-e943d86ef6db tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:28.339291 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f425d510-8f15-4422-835c-e943d86ef6db tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:28.346596 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f425d510-8f15-4422-835c-e943d86ef6db tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:28.347033 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f425d510-8f15-4422-835c-e943d86ef6db tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:28.347918 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f425d510-8f15-4422-835c-e943d86ef6db tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:28.348357 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f425d510-8f15-4422-835c-e943d86ef6db tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:28.493526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f425d510-8f15-4422-835c-e943d86ef6db tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:28.501231 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f425d510-8f15-4422-835c-e943d86ef6db tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1576 microversion: 2.1 time: 0.167145 Jul 27 04:31:28.506137 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 406/821] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:28 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:31:29.524254 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f115e0af-565f-4775-9758-670a1b67ecde tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:29.524959 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f115e0af-565f-4775-9758-670a1b67ecde tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:29.531398 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f115e0af-565f-4775-9758-670a1b67ecde tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:29.531848 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f115e0af-565f-4775-9758-670a1b67ecde tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:29.532610 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f115e0af-565f-4775-9758-670a1b67ecde tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:29.533068 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f115e0af-565f-4775-9758-670a1b67ecde tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:29.747632 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f115e0af-565f-4775-9758-670a1b67ecde tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:29.755871 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f115e0af-565f-4775-9758-670a1b67ecde tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1576 microversion: 2.1 time: 0.235865 Jul 27 04:31:29.756449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 416/822] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:29 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:30.072920 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-45333d29-02b1-4da2-94f4-b8d6dbedeafd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:30.073490 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-45333d29-02b1-4da2-94f4-b8d6dbedeafd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:30.079786 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-45333d29-02b1-4da2-94f4-b8d6dbedeafd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:30.080818 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-45333d29-02b1-4da2-94f4-b8d6dbedeafd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:30.081608 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-45333d29-02b1-4da2-94f4-b8d6dbedeafd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:30.082054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-45333d29-02b1-4da2-94f4-b8d6dbedeafd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:30.104584 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-45333d29-02b1-4da2-94f4-b8d6dbedeafd tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b/ips" status: 200 len: 150 microversion: 2.1 time: 0.035747 Jul 27 04:31:30.105306 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 407/823] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Jul 27 04:31:30 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:31:30.367012 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-9cd90d47-99df-40d9-a797-d4c33a2ee595 req-5f558477-d7d9-4d6c-9ac2-90972f07d41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebadd469-2167-427c-99e3-da0d244d3c43", "name": "network-vif-deleted", "tag": "4df25964-f8b6-4580-9b35-69da892880e3"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:31:30.381534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-9cd90d47-99df-40d9-a797-d4c33a2ee595 req-5f558477-d7d9-4d6c-9ac2-90972f07d41d service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:30.382744 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-9cd90d47-99df-40d9-a797-d4c33a2ee595 req-5f558477-d7d9-4d6c-9ac2-90972f07d41d service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:30.397843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-9cd90d47-99df-40d9-a797-d4c33a2ee595 req-5f558477-d7d9-4d6c-9ac2-90972f07d41d service nova] Creating event network-vif-deleted:4df25964-f8b6-4580-9b35-69da892880e3 for instance ebadd469-2167-427c-99e3-da0d244d3c43 on hv-cinder-85098 Jul 27 04:31:30.403852 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-9cd90d47-99df-40d9-a797-d4c33a2ee595 req-5f558477-d7d9-4d6c-9ac2-90972f07d41d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041064 Jul 27 04:31:30.405204 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 417/824] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:31:30.777451 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6c383df5-cf1e-4d30-bb6f-02dbc88ce0b0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:30.778239 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6c383df5-cf1e-4d30-bb6f-02dbc88ce0b0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:30.785054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6c383df5-cf1e-4d30-bb6f-02dbc88ce0b0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:30.785477 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6c383df5-cf1e-4d30-bb6f-02dbc88ce0b0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:30.786294 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6c383df5-cf1e-4d30-bb6f-02dbc88ce0b0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:30.786735 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6c383df5-cf1e-4d30-bb6f-02dbc88ce0b0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:30.817988 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6c383df5-cf1e-4d30-bb6f-02dbc88ce0b0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:30.818442 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6c383df5-cf1e-4d30-bb6f-02dbc88ce0b0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:30.818894 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.objects.instance [None req-6c383df5-cf1e-4d30-bb6f-02dbc88ce0b0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lazy-loading 'fault' on Instance uuid ebadd469-2167-427c-99e3-da0d244d3c43 {{(pid=117739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:31:30.859159 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6c383df5-cf1e-4d30-bb6f-02dbc88ce0b0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5b08eede4409484dc2f4305b5298a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3825c2630a4f47e0b029bd0c90875108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:30.866507 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6c383df5-cf1e-4d30-bb6f-02dbc88ce0b0 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 200 len: 1230 microversion: 2.1 time: 0.092953 Jul 27 04:31:30.867112 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 408/825] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:30 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:31.454874 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4567809d-3ded-4bd5-a0d5-7701c8e124ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62948421-33b1-464d-a7dc-69acf2c64675"}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:31:31.457357 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4567809d-3ded-4bd5-a0d5-7701c8e124ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:31.463967 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4567809d-3ded-4bd5-a0d5-7701c8e124ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:31.464411 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4567809d-3ded-4bd5-a0d5-7701c8e124ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:31.465171 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4567809d-3ded-4bd5-a0d5-7701c8e124ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:31.465610 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4567809d-3ded-4bd5-a0d5-7701c8e124ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:31.700871 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4567809d-3ded-4bd5-a0d5-7701c8e124ab tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "POST /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250028 Jul 27 04:31:31.701622 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 418/826] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:31:31 2022] POST /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:31:31.887665 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-1eebbae3-932c-44f5-a526-1207ea229312 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:31.888275 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-1eebbae3-932c-44f5-a526-1207ea229312 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: ebadd469-2167-427c-99e3-da0d244d3c43] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:31.895512 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1eebbae3-932c-44f5-a526-1207ea229312 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:31.895959 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1eebbae3-932c-44f5-a526-1207ea229312 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:31.896723 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1eebbae3-932c-44f5-a526-1207ea229312 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:31.897158 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1eebbae3-932c-44f5-a526-1207ea229312 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:31.911336 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-1eebbae3-932c-44f5-a526-1207ea229312 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] HTTP exception thrown: Instance ebadd469-2167-427c-99e3-da0d244d3c43 could not be found. Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-1eebbae3-932c-44f5-a526-1207ea229312 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Request method failure captured: Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 HTTP/1.1 Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L3hSmP2SOJhV3F-1jSFLV_MUh7OtRi5bPIi_AQ8z2gIQtYCReiWttEnQGEB0fYGbdTgL1YGHqTPw5NiZeSuQEe9b_vcpfkxtpsrP-j9J1SgbA2wnuBzLmLQNP9gkGZkTnxnq_EN5F3_0GmwApFpSw2qY8ByBk2Y3pbT38MPT_QQoEQ Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: 3825c2630a4f47e0b029bd0c90875108 Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-TestVolumeBootPattern-77715254 Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:31:31.912996 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:31:31.914514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:31:31.914514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-TestVolumeBootPattern-77715254 Jul 27 04:31:31.914514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: 3825c2630a4f47e0b029bd0c90875108 Jul 27 04:31:31.914514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-TestVolumeBootPattern-77715254 Jul 27 04:31:31.914514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-TestVolumeBootPattern-77715254-project Jul 27 04:31:31.914514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:31:31.914514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:31:31.914514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: eea5b08eede4409484dc2f4305b5298a Jul 27 04:31:31.914514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-TestVolumeBootPattern-77715254-project Jul 27 04:31:31.914514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:31:31.914514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance ebadd469-2167-427c-99e3-da0d244d3c43 could not be found. Jul 27 04:31:31.914514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': 'ebadd469-2167-427c-99e3-da0d244d3c43'} Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebadd469-2167-427c-99e3-da0d244d3c43 could not be found. Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:31:31.915283 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebadd469-2167-427c-99e3-da0d244d3c43 could not be found. Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebadd469-2167-427c-99e3-da0d244d3c43 could not be found. Jul 27 04:31:31.916600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:31.917737 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-1eebbae3-932c-44f5-a526-1207ea229312 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Returning 404 to user: Instance ebadd469-2167-427c-99e3-da0d244d3c43 could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:31:31.917737 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-1eebbae3-932c-44f5-a526-1207ea229312 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43" status: 404 len: 111 microversion: 2.1 time: 0.030595 Jul 27 04:31:31.917737 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 409/827] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:31 2022] GET /compute/v2.1/servers/ebadd469-2167-427c-99e3-da0d244d3c43 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:31:32.358029 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4d5f94ea-5286-4929-8d5b-1cb85aab2f79 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:32.358608 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4d5f94ea-5286-4929-8d5b-1cb85aab2f79 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:32.365445 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d5f94ea-5286-4929-8d5b-1cb85aab2f79 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:32.365888 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d5f94ea-5286-4929-8d5b-1cb85aab2f79 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:32.366686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d5f94ea-5286-4929-8d5b-1cb85aab2f79 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:32.367122 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4d5f94ea-5286-4929-8d5b-1cb85aab2f79 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:32.380857 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-4d5f94ea-5286-4929-8d5b-1cb85aab2f79 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] HTTP exception thrown: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4d5f94ea-5286-4929-8d5b-1cb85aab2f79 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Request method failure captured: Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: DELETE /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 HTTP/1.1 Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L3hSmP2SOJhV3F-1jSFLV_MUh7OtRi5bPIi_AQ8z2gIQtYCReiWttEnQGEB0fYGbdTgL1YGHqTPw5NiZeSuQEe9b_vcpfkxtpsrP-j9J1SgbA2wnuBzLmLQNP9gkGZkTnxnq_EN5F3_0GmwApFpSw2qY8ByBk2Y3pbT38MPT_QQoEQ Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 3825c2630a4f47e0b029bd0c90875108 Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-TestVolumeBootPattern-77715254 Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:31:32.382795 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:31:32.384449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:31:32.384449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-TestVolumeBootPattern-77715254 Jul 27 04:31:32.384449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 3825c2630a4f47e0b029bd0c90875108 Jul 27 04:31:32.384449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-TestVolumeBootPattern-77715254 Jul 27 04:31:32.384449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-TestVolumeBootPattern-77715254-project Jul 27 04:31:32.384449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:31:32.384449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:31:32.384449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: eea5b08eede4409484dc2f4305b5298a Jul 27 04:31:32.384449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-TestVolumeBootPattern-77715254-project Jul 27 04:31:32.384449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:31:32.384449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:31:32.384449 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': 'a1dc2957-3830-46b6-b50c-05806cb4e259'} Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:31:32.385303 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:31:32.386865 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:32.388508 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4d5f94ea-5286-4929-8d5b-1cb85aab2f79 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Returning 404 to user: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:31:32.388508 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4d5f94ea-5286-4929-8d5b-1cb85aab2f79 tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 404 len: 111 microversion: 2.1 time: 0.030626 Jul 27 04:31:32.388508 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 419/828] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:31:32 2022] DELETE /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:31:32.394114 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6553a1c9-9a83-4ba8-9c0c-0844db07d25f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:32.394720 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6553a1c9-9a83-4ba8-9c0c-0844db07d25f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] [instance: a1dc2957-3830-46b6-b50c-05806cb4e259] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:32.400686 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6553a1c9-9a83-4ba8-9c0c-0844db07d25f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:32.401125 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6553a1c9-9a83-4ba8-9c0c-0844db07d25f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:32.401880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6553a1c9-9a83-4ba8-9c0c-0844db07d25f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:32.402338 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6553a1c9-9a83-4ba8-9c0c-0844db07d25f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:32.415809 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-6553a1c9-9a83-4ba8-9c0c-0844db07d25f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] HTTP exception thrown: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6553a1c9-9a83-4ba8-9c0c-0844db07d25f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Request method failure captured: Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 HTTP/1.1 Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L3hSmP2SOJhV3F-1jSFLV_MUh7OtRi5bPIi_AQ8z2gIQtYCReiWttEnQGEB0fYGbdTgL1YGHqTPw5NiZeSuQEe9b_vcpfkxtpsrP-j9J1SgbA2wnuBzLmLQNP9gkGZkTnxnq_EN5F3_0GmwApFpSw2qY8ByBk2Y3pbT38MPT_QQoEQ Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: 3825c2630a4f47e0b029bd0c90875108 Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-TestVolumeBootPattern-77715254 Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:31:32.417309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:31:32.418908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3825c2630a4f47e0b029bd0c90875108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:31:32.418908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-TestVolumeBootPattern-77715254 Jul 27 04:31:32.418908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: 3825c2630a4f47e0b029bd0c90875108 Jul 27 04:31:32.418908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-TestVolumeBootPattern-77715254 Jul 27 04:31:32.418908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-TestVolumeBootPattern-77715254-project Jul 27 04:31:32.418908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:31:32.418908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:31:32.418908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: eea5b08eede4409484dc2f4305b5298a Jul 27 04:31:32.418908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-TestVolumeBootPattern-77715254-project Jul 27 04:31:32.418908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:31:32.418908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:31:32.418908 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': 'a1dc2957-3830-46b6-b50c-05806cb4e259'} Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:31:32.420124 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. Jul 27 04:31:32.421588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:32.423158 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6553a1c9-9a83-4ba8-9c0c-0844db07d25f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Returning 404 to user: Instance a1dc2957-3830-46b6-b50c-05806cb4e259 could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:31:32.423158 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6553a1c9-9a83-4ba8-9c0c-0844db07d25f tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259" status: 404 len: 111 microversion: 2.1 time: 0.029180 Jul 27 04:31:32.423158 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 410/829] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:32 2022] GET /compute/v2.1/servers/a1dc2957-3830-46b6-b50c-05806cb4e259 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:31:33.714992 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8732838c-d733-4748-a3fe-4ef24dd9bdfe tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] Calling method '.version_select at 0x7f21d5b8bd30>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:33.734037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8732838c-d733-4748-a3fe-4ef24dd9bdfe tempest-TestVolumeBootPattern-77715254 tempest-TestVolumeBootPattern-77715254-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1427079078" status: 202 len: 0 microversion: 2.1 time: 0.022938 Jul 27 04:31:33.734791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 420/830] 10.222.0.46 () {58 vars in 1263 bytes} [Wed Jul 27 04:31:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1427079078 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:31:36.677795 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ee5070a8-7125-4f4a-a8be-bebd772c443f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:36.679815 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ee5070a8-7125-4f4a-a8be-bebd772c443f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:36.688460 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ee5070a8-7125-4f4a-a8be-bebd772c443f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:36.690816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ee5070a8-7125-4f4a-a8be-bebd772c443f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:36.692147 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ee5070a8-7125-4f4a-a8be-bebd772c443f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:36.692700 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ee5070a8-7125-4f4a-a8be-bebd772c443f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:36.791847 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.objects.instance [None req-ee5070a8-7125-4f4a-a8be-bebd772c443f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lazy-loading 'services' on Instance uuid 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 {{(pid=117739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:31:36.875919 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ee5070a8-7125-4f4a-a8be-bebd772c443f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "DELETE /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/os-volume_attachments/f0114cae-f966-4038-8e88-54680604695d" status: 202 len: 0 microversion: 2.1 time: 0.200891 Jul 27 04:31:36.876517 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 411/831] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Jul 27 04:31:36 2022] DELETE /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/os-volume_attachments/f0114cae-f966-4038-8e88-54680604695d => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:31:38.323855 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-afdf9789-e381-417e-805f-86945f556d7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:38.325137 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-afdf9789-e381-417e-805f-86945f556d7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:38.335312 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-afdf9789-e381-417e-805f-86945f556d7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:38.335781 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-afdf9789-e381-417e-805f-86945f556d7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:38.336802 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-afdf9789-e381-417e-805f-86945f556d7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:38.337409 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-afdf9789-e381-417e-805f-86945f556d7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:38.421553 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-afdf9789-e381-417e-805f-86945f556d7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lazy-loading 'services' on Instance uuid 54855bde-7670-4dc8-8f13-818e831e5f0b {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:31:38.503242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-afdf9789-e381-417e-805f-86945f556d7f tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b/os-volume_attachments/62948421-33b1-464d-a7dc-69acf2c64675" status: 202 len: 0 microversion: 2.1 time: 0.184027 Jul 27 04:31:38.504098 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 421/832] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Jul 27 04:31:38 2022] DELETE /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b/os-volume_attachments/62948421-33b1-464d-a7dc-69acf2c64675 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:31:38.513160 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-82422674-2133-4a6e-a65c-d12f75fb2ff6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:38.515499 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-82422674-2133-4a6e-a65c-d12f75fb2ff6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:38.530303 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-82422674-2133-4a6e-a65c-d12f75fb2ff6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:38.530732 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-82422674-2133-4a6e-a65c-d12f75fb2ff6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:38.531621 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-82422674-2133-4a6e-a65c-d12f75fb2ff6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:38.532065 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-82422674-2133-4a6e-a65c-d12f75fb2ff6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:38.564880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-82422674-2133-4a6e-a65c-d12f75fb2ff6 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055235 Jul 27 04:31:38.565670 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 412/833] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:31:38 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:31:39.068489 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 04:31:39.069319 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Wed Jul 27 04:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 04:31:39.092540 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7e6c644d-54d3-4918-aec1-d1154fd0678e tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:31:39.099168 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7e6c644d-54d3-4918-aec1-d1154fd0678e tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:39.099897 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7e6c644d-54d3-4918-aec1-d1154fd0678e tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:39.130825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-7e6c644d-54d3-4918-aec1-d1154fd0678e tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Going to try to stop instance {{(pid=117740) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 27 04:31:39.183651 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-7e6c644d-54d3-4918-aec1-d1154fd0678e tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "POST /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/action" status: 202 len: 0 microversion: 2.1 time: 0.095142 Jul 27 04:31:39.184862 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 422/834] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:31:39 2022] POST /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:31:39.194830 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2f82feba-bc50-4414-898d-8f76fa09a2a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:39.195573 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2f82feba-bc50-4414-898d-8f76fa09a2a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:39.217102 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2f82feba-bc50-4414-898d-8f76fa09a2a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:39.217574 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2f82feba-bc50-4414-898d-8f76fa09a2a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:39.218536 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2f82feba-bc50-4414-898d-8f76fa09a2a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:39.220991 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2f82feba-bc50-4414-898d-8f76fa09a2a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:39.361923 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2f82feba-bc50-4414-898d-8f76fa09a2a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:39.369885 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2f82feba-bc50-4414-898d-8f76fa09a2a2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1671 microversion: 2.1 time: 0.179353 Jul 27 04:31:39.370850 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 413/835] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:39 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1671 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:39.577559 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-24098bd7-b5ad-4c94-822e-aac744d6bebf tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:39.579849 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-24098bd7-b5ad-4c94-822e-aac744d6bebf tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:39.586531 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-24098bd7-b5ad-4c94-822e-aac744d6bebf tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:39.586984 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-24098bd7-b5ad-4c94-822e-aac744d6bebf tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:39.587776 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-24098bd7-b5ad-4c94-822e-aac744d6bebf tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:39.588452 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-24098bd7-b5ad-4c94-822e-aac744d6bebf tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:39.622597 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-24098bd7-b5ad-4c94-822e-aac744d6bebf tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049488 Jul 27 04:31:39.623491 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 423/836] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:31:39 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 04:31:39.684899 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-feb421cb-4994-4b7e-85c8-69e4538d8773 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:39.685367 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-feb421cb-4994-4b7e-85c8-69e4538d8773 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:39.692534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-feb421cb-4994-4b7e-85c8-69e4538d8773 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:39.692971 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-feb421cb-4994-4b7e-85c8-69e4538d8773 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:39.693737 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-feb421cb-4994-4b7e-85c8-69e4538d8773 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:39.694204 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-feb421cb-4994-4b7e-85c8-69e4538d8773 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:39.718925 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-feb421cb-4994-4b7e-85c8-69e4538d8773 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Going to try to terminate instance {{(pid=117739) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:31:39.804285 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-feb421cb-4994-4b7e-85c8-69e4538d8773 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 204 len: 0 microversion: 2.1 time: 0.122549 Jul 27 04:31:39.805141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 414/837] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:31:39 2022] DELETE /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:31:39.813558 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c6e93ce5-6dff-4b80-95a8-fd4964abdb85 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:39.814266 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c6e93ce5-6dff-4b80-95a8-fd4964abdb85 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:39.829002 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c6e93ce5-6dff-4b80-95a8-fd4964abdb85 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:39.829457 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c6e93ce5-6dff-4b80-95a8-fd4964abdb85 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:39.830318 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c6e93ce5-6dff-4b80-95a8-fd4964abdb85 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:39.830758 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c6e93ce5-6dff-4b80-95a8-fd4964abdb85 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:39.858749 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=5,nova_cell1:INSERT=5 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:31:39.999072 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-c6e93ce5-6dff-4b80-95a8-fd4964abdb85 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:40.008174 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c6e93ce5-6dff-4b80-95a8-fd4964abdb85 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 200 len: 1680 microversion: 2.1 time: 0.198779 Jul 27 04:31:40.009293 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 424/838] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:39 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:40.396974 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e293d6ec-de33-47ed-a3ca-fccf6678dc02 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:40.396974 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e293d6ec-de33-47ed-a3ca-fccf6678dc02 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:40.406392 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e293d6ec-de33-47ed-a3ca-fccf6678dc02 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:40.406931 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e293d6ec-de33-47ed-a3ca-fccf6678dc02 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:40.407644 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e293d6ec-de33-47ed-a3ca-fccf6678dc02 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:40.408159 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e293d6ec-de33-47ed-a3ca-fccf6678dc02 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:40.625887 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e293d6ec-de33-47ed-a3ca-fccf6678dc02 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:40.634261 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e293d6ec-de33-47ed-a3ca-fccf6678dc02 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1671 microversion: 2.1 time: 0.244196 Jul 27 04:31:40.634844 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 415/839] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:40 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1671 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:41.030328 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e48cfd91-d697-4ce6-9e70-b2220a64dd4e tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:41.030948 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e48cfd91-d697-4ce6-9e70-b2220a64dd4e tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:41.038448 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e48cfd91-d697-4ce6-9e70-b2220a64dd4e tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:41.038896 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e48cfd91-d697-4ce6-9e70-b2220a64dd4e tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:41.039871 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e48cfd91-d697-4ce6-9e70-b2220a64dd4e tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:41.040313 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e48cfd91-d697-4ce6-9e70-b2220a64dd4e tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:41.401936 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e48cfd91-d697-4ce6-9e70-b2220a64dd4e tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:41.409583 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e48cfd91-d697-4ce6-9e70-b2220a64dd4e tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 200 len: 1680 microversion: 2.1 time: 0.383089 Jul 27 04:31:41.410401 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 425/840] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:41 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 1680 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:41.655840 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ce73ef51-8a3b-4142-92f7-9577220e0467 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:41.657125 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ce73ef51-8a3b-4142-92f7-9577220e0467 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:41.665055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ce73ef51-8a3b-4142-92f7-9577220e0467 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:41.665509 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ce73ef51-8a3b-4142-92f7-9577220e0467 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:41.666341 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ce73ef51-8a3b-4142-92f7-9577220e0467 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:41.666788 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ce73ef51-8a3b-4142-92f7-9577220e0467 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:41.916196 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ce73ef51-8a3b-4142-92f7-9577220e0467 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:41.924422 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ce73ef51-8a3b-4142-92f7-9577220e0467 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1671 microversion: 2.1 time: 0.272077 Jul 27 04:31:41.925107 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 416/841] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:41 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1671 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:42.331662 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-01317f54-9164-4b52-8d4a-c34935b87c2d req-e409ef0d-c144-42a3-997e-14e2a803c7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54855bde-7670-4dc8-8f13-818e831e5f0b", "name": "network-vif-deleted", "tag": "6a98180b-60a8-4f68-9bc5-865099b842ef"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:31:42.342527 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-01317f54-9164-4b52-8d4a-c34935b87c2d req-e409ef0d-c144-42a3-997e-14e2a803c7e3 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:42.342527 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-01317f54-9164-4b52-8d4a-c34935b87c2d req-e409ef0d-c144-42a3-997e-14e2a803c7e3 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:42.356084 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-01317f54-9164-4b52-8d4a-c34935b87c2d req-e409ef0d-c144-42a3-997e-14e2a803c7e3 service nova] Creating event network-vif-deleted:6a98180b-60a8-4f68-9bc5-865099b842ef for instance 54855bde-7670-4dc8-8f13-818e831e5f0b on hv-cinder-85098 Jul 27 04:31:42.361621 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-01317f54-9164-4b52-8d4a-c34935b87c2d req-e409ef0d-c144-42a3-997e-14e2a803c7e3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033808 Jul 27 04:31:42.362475 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 426/842] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:31:42.440425 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e490d06a-8d3d-406e-b675-0c8ad0db170c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:42.441529 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e490d06a-8d3d-406e-b675-0c8ad0db170c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:42.448624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e490d06a-8d3d-406e-b675-0c8ad0db170c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:42.449420 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e490d06a-8d3d-406e-b675-0c8ad0db170c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:42.451581 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e490d06a-8d3d-406e-b675-0c8ad0db170c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:42.452270 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e490d06a-8d3d-406e-b675-0c8ad0db170c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:42.492435 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e490d06a-8d3d-406e-b675-0c8ad0db170c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:42.493205 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e490d06a-8d3d-406e-b675-0c8ad0db170c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:42.493762 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.objects.instance [None req-e490d06a-8d3d-406e-b675-0c8ad0db170c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lazy-loading 'fault' on Instance uuid 54855bde-7670-4dc8-8f13-818e831e5f0b {{(pid=117739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:31:42.539011 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e490d06a-8d3d-406e-b675-0c8ad0db170c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbc27f4433e4c48a75b216540a9022f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51c6088dfa44df848e339d61bac664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:42.548076 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e490d06a-8d3d-406e-b675-0c8ad0db170c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 200 len: 1330 microversion: 2.1 time: 0.112435 Jul 27 04:31:42.550448 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 417/843] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:42 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 1330 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:42.945820 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a6982a28-e3a3-4c2a-b8fa-4ef0b317eff6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:42.946618 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a6982a28-e3a3-4c2a-b8fa-4ef0b317eff6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:42.952990 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a6982a28-e3a3-4c2a-b8fa-4ef0b317eff6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:42.953434 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a6982a28-e3a3-4c2a-b8fa-4ef0b317eff6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:42.954215 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a6982a28-e3a3-4c2a-b8fa-4ef0b317eff6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:42.954923 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a6982a28-e3a3-4c2a-b8fa-4ef0b317eff6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:43.089698 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-a6982a28-e3a3-4c2a-b8fa-4ef0b317eff6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:43.098155 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a6982a28-e3a3-4c2a-b8fa-4ef0b317eff6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1671 microversion: 2.1 time: 0.156327 Jul 27 04:31:43.098825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 427/844] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:42 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:43.571110 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f5d68f77-2947-4abd-b74e-bbcae28bdf91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:43.571656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f5d68f77-2947-4abd-b74e-bbcae28bdf91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:43.578330 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f5d68f77-2947-4abd-b74e-bbcae28bdf91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:43.578779 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f5d68f77-2947-4abd-b74e-bbcae28bdf91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:43.579547 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f5d68f77-2947-4abd-b74e-bbcae28bdf91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:43.580243 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f5d68f77-2947-4abd-b74e-bbcae28bdf91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:43.593354 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-f5d68f77-2947-4abd-b74e-bbcae28bdf91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f5d68f77-2947-4abd-b74e-bbcae28bdf91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b HTTP/1.1 Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:31:43.594969 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:31:43.597391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:31:43.597391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:43.597391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:43.597391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:43.597391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:43.597391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:31:43.597391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:31:43.597391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:31:43.597391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:43.597391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:31:43.597391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:43.597391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '54855bde-7670-4dc8-8f13-818e831e5f0b'} Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:31:43.598247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:43.599778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:43.601054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f5d68f77-2947-4abd-b74e-bbcae28bdf91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 404 to user: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:31:43.601054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f5d68f77-2947-4abd-b74e-bbcae28bdf91 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 404 len: 111 microversion: 2.1 time: 0.029765 Jul 27 04:31:43.601054 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 418/845] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:43 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:31:43.605629 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-8a928562-f531-4560-a4e1-4f8b0ee8f4f4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '.version_select at 0x7f21d5a0e310>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:43.624772 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-8a928562-f531-4560-a4e1-4f8b0ee8f4f4 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-796274630" status: 202 len: 0 microversion: 2.1 time: 0.022882 Jul 27 04:31:43.625323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 428/846] 10.222.0.46 () {58 vars in 1218 bytes} [Wed Jul 27 04:31:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-796274630 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:31:44.119440 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-19ff942f-823f-4603-8ef1-bee921a8d129 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:44.120058 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-19ff942f-823f-4603-8ef1-bee921a8d129 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:44.126226 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-19ff942f-823f-4603-8ef1-bee921a8d129 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:44.126723 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-19ff942f-823f-4603-8ef1-bee921a8d129 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:44.127634 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-19ff942f-823f-4603-8ef1-bee921a8d129 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:44.128069 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-19ff942f-823f-4603-8ef1-bee921a8d129 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:44.147471 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:31:44.338432 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-19ff942f-823f-4603-8ef1-bee921a8d129 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:44.345798 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-19ff942f-823f-4603-8ef1-bee921a8d129 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1671 microversion: 2.1 time: 0.230181 Jul 27 04:31:44.346504 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 419/847] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:44 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1671 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:45.367697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f28a38b3-17e5-4273-a4c7-92d72a15f9cd tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:45.368320 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f28a38b3-17e5-4273-a4c7-92d72a15f9cd tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:45.375143 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f28a38b3-17e5-4273-a4c7-92d72a15f9cd tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:45.375589 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f28a38b3-17e5-4273-a4c7-92d72a15f9cd tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:45.376350 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f28a38b3-17e5-4273-a4c7-92d72a15f9cd tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:45.376786 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f28a38b3-17e5-4273-a4c7-92d72a15f9cd tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:45.509130 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f28a38b3-17e5-4273-a4c7-92d72a15f9cd tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:45.516595 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f28a38b3-17e5-4273-a4c7-92d72a15f9cd tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1671 microversion: 2.1 time: 0.153321 Jul 27 04:31:45.517698 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 429/848] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:45 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:45.703185 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3ed96a06-64d2-45e6-a550-007e31bcbb55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:45.703690 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-3ed96a06-64d2-45e6-a550-007e31bcbb55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:45.710964 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3ed96a06-64d2-45e6-a550-007e31bcbb55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:45.711415 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3ed96a06-64d2-45e6-a550-007e31bcbb55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:45.712183 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3ed96a06-64d2-45e6-a550-007e31bcbb55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:45.712617 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3ed96a06-64d2-45e6-a550-007e31bcbb55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:45.726729 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-3ed96a06-64d2-45e6-a550-007e31bcbb55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3ed96a06-64d2-45e6-a550-007e31bcbb55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: DELETE /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b HTTP/1.1 Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:31:45.728260 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:31:45.729832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:31:45.729832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:45.729832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:45.729832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:45.729832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:45.729832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:31:45.729832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:31:45.729832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:31:45.729832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:45.729832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:31:45.729832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:45.729832 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '54855bde-7670-4dc8-8f13-818e831e5f0b'} Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:31:45.730816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:45.732407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:45.734170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3ed96a06-64d2-45e6-a550-007e31bcbb55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 404 to user: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:31:45.734170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-3ed96a06-64d2-45e6-a550-007e31bcbb55 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 404 len: 111 microversion: 2.1 time: 0.030465 Jul 27 04:31:45.734170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 420/849] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:31:45 2022] DELETE /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:31:45.738284 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ba6297a5-6e04-4d46-87dc-5508614a1c4c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:45.738891 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ba6297a5-6e04-4d46-87dc-5508614a1c4c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 54855bde-7670-4dc8-8f13-818e831e5f0b] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:45.744842 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba6297a5-6e04-4d46-87dc-5508614a1c4c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:45.745288 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba6297a5-6e04-4d46-87dc-5508614a1c4c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:45.746067 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba6297a5-6e04-4d46-87dc-5508614a1c4c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:45.746496 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ba6297a5-6e04-4d46-87dc-5508614a1c4c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:45.759816 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-ba6297a5-6e04-4d46-87dc-5508614a1c4c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ba6297a5-6e04-4d46-87dc-5508614a1c4c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b HTTP/1.1 Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:31:45.761395 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:31:45.762949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:31:45.762949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:45.762949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:45.762949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:45.762949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:45.762949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:31:45.762949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:31:45.762949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:31:45.762949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:45.762949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:31:45.762949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:45.762949 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '54855bde-7670-4dc8-8f13-818e831e5f0b'} Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:31:45.763843 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. Jul 27 04:31:45.765294 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:45.766602 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ba6297a5-6e04-4d46-87dc-5508614a1c4c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 404 to user: Instance 54855bde-7670-4dc8-8f13-818e831e5f0b could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:31:45.766602 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ba6297a5-6e04-4d46-87dc-5508614a1c4c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b" status: 404 len: 111 microversion: 2.1 time: 0.028396 Jul 27 04:31:45.766602 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 430/850] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:45 2022] GET /compute/v2.1/servers/54855bde-7670-4dc8-8f13-818e831e5f0b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:31:46.538857 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4d1e8bdd-d786-488a-a98e-8b3dd7a1645a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:46.539467 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4d1e8bdd-d786-488a-a98e-8b3dd7a1645a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:46.545419 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4d1e8bdd-d786-488a-a98e-8b3dd7a1645a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:46.545866 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4d1e8bdd-d786-488a-a98e-8b3dd7a1645a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:46.546667 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4d1e8bdd-d786-488a-a98e-8b3dd7a1645a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:46.547109 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4d1e8bdd-d786-488a-a98e-8b3dd7a1645a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:46.684078 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4d1e8bdd-d786-488a-a98e-8b3dd7a1645a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:46.691434 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4d1e8bdd-d786-488a-a98e-8b3dd7a1645a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1671 microversion: 2.1 time: 0.156489 Jul 27 04:31:46.691987 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 421/851] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:46 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:46.900139 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a73a5b82-a773-4177-9cc2-34d1ca61fd63 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:46.900678 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-a73a5b82-a773-4177-9cc2-34d1ca61fd63 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:46.907061 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a73a5b82-a773-4177-9cc2-34d1ca61fd63 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:46.907503 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a73a5b82-a773-4177-9cc2-34d1ca61fd63 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:46.908867 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a73a5b82-a773-4177-9cc2-34d1ca61fd63 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:46.909300 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-a73a5b82-a773-4177-9cc2-34d1ca61fd63 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:46.922215 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-a73a5b82-a773-4177-9cc2-34d1ca61fd63 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a73a5b82-a773-4177-9cc2-34d1ca61fd63 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: DELETE /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 HTTP/1.1 Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:31:46.923810 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:31:46.925242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:31:46.925242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:46.925242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:46.925242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:46.925242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:46.925242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:31:46.925242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:31:46.925242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:31:46.925242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:46.925242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:31:46.925242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:31:46.925242 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '995a6cca-8a06-4a14-9825-6961ef0a7785'} Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:31:46.926065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:31:46.927534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.928967 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-a73a5b82-a773-4177-9cc2-34d1ca61fd63 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 404 to user: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:31:46.928967 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-a73a5b82-a773-4177-9cc2-34d1ca61fd63 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 404 len: 111 microversion: 2.1 time: 0.028888 Jul 27 04:31:46.928967 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 431/852] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:31:46 2022] DELETE /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:31:46.933514 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-632d9560-3a3d-4530-a942-8f7d9275296c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:46.934152 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-632d9560-3a3d-4530-a942-8f7d9275296c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 995a6cca-8a06-4a14-9825-6961ef0a7785] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:46.940743 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-632d9560-3a3d-4530-a942-8f7d9275296c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:46.941184 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-632d9560-3a3d-4530-a942-8f7d9275296c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:46.941951 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-632d9560-3a3d-4530-a942-8f7d9275296c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:46.942403 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-632d9560-3a3d-4530-a942-8f7d9275296c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:46.956037 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-632d9560-3a3d-4530-a942-8f7d9275296c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-632d9560-3a3d-4530-a942-8f7d9275296c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 HTTP/1.1 Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:31:46.957540 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:31:46.959464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:31:46.959464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:46.959464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:46.959464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:46.959464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:46.959464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:31:46.959464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:31:46.959464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:31:46.959464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:46.959464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:31:46.959464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:31:46.959464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '995a6cca-8a06-4a14-9825-6961ef0a7785'} Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:31:46.960358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. Jul 27 04:31:46.961789 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.963116 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-632d9560-3a3d-4530-a942-8f7d9275296c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 404 to user: Instance 995a6cca-8a06-4a14-9825-6961ef0a7785 could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:31:46.963116 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-632d9560-3a3d-4530-a942-8f7d9275296c tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785" status: 404 len: 111 microversion: 2.1 time: 0.029234 Jul 27 04:31:46.963116 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 422/853] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:46 2022] GET /compute/v2.1/servers/995a6cca-8a06-4a14-9825-6961ef0a7785 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:31:46.967544 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-5ef78527-e002-4d4b-9211-a59049a121ae tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:46.968072 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-5ef78527-e002-4d4b-9211-a59049a121ae tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:46.974803 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ef78527-e002-4d4b-9211-a59049a121ae tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:46.975254 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ef78527-e002-4d4b-9211-a59049a121ae tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:46.976023 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ef78527-e002-4d4b-9211-a59049a121ae tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:46.976462 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ef78527-e002-4d4b-9211-a59049a121ae tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:46.989450 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-5ef78527-e002-4d4b-9211-a59049a121ae tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-5ef78527-e002-4d4b-9211-a59049a121ae tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: DELETE /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd HTTP/1.1 Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:31:46.990993 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:31:46.992516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:31:46.992516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:46.992516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:46.992516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:46.992516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:46.992516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:31:46.992516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:31:46.992516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:31:46.992516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:46.992516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:31:46.992516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:31:46.992516 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '8efc620d-10a0-4def-b781-58225aaad7dd'} Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:31:46.993581 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:31:46.995037 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:46.996425 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-5ef78527-e002-4d4b-9211-a59049a121ae tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 404 to user: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:31:46.996425 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-5ef78527-e002-4d4b-9211-a59049a121ae tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 404 len: 111 microversion: 2.1 time: 0.028647 Jul 27 04:31:46.996425 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 432/854] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:31:46 2022] DELETE /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:31:47.000665 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b3480e5e-de7f-46b6-9f6e-4bab4afa2f5b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:47.001274 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-b3480e5e-de7f-46b6-9f6e-4bab4afa2f5b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 8efc620d-10a0-4def-b781-58225aaad7dd] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:47.007453 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b3480e5e-de7f-46b6-9f6e-4bab4afa2f5b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:47.007894 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b3480e5e-de7f-46b6-9f6e-4bab4afa2f5b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:47.008643 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b3480e5e-de7f-46b6-9f6e-4bab4afa2f5b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:47.009072 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b3480e5e-de7f-46b6-9f6e-4bab4afa2f5b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:47.022669 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-b3480e5e-de7f-46b6-9f6e-4bab4afa2f5b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b3480e5e-de7f-46b6-9f6e-4bab4afa2f5b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd HTTP/1.1 Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:31:47.024133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:31:47.025716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:31:47.025716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:47.025716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:47.025716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:47.025716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:47.025716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:31:47.025716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:31:47.025716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:31:47.025716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:47.025716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:31:47.025716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:31:47.025716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '8efc620d-10a0-4def-b781-58225aaad7dd'} Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:31:47.029564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. Jul 27 04:31:47.031055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:47.032995 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b3480e5e-de7f-46b6-9f6e-4bab4afa2f5b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 404 to user: Instance 8efc620d-10a0-4def-b781-58225aaad7dd could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:31:47.032995 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-b3480e5e-de7f-46b6-9f6e-4bab4afa2f5b tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd" status: 404 len: 111 microversion: 2.1 time: 0.028615 Jul 27 04:31:47.032995 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 423/855] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:46 2022] GET /compute/v2.1/servers/8efc620d-10a0-4def-b781-58225aaad7dd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:31:47.712095 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-da7bc552-746b-4edf-8406-66cc8eb8280c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:47.712634 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-da7bc552-746b-4edf-8406-66cc8eb8280c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:47.718646 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-da7bc552-746b-4edf-8406-66cc8eb8280c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:47.719090 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-da7bc552-746b-4edf-8406-66cc8eb8280c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:47.719842 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-da7bc552-746b-4edf-8406-66cc8eb8280c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:47.720937 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-da7bc552-746b-4edf-8406-66cc8eb8280c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:47.850496 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-da7bc552-746b-4edf-8406-66cc8eb8280c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:47.858083 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-da7bc552-746b-4edf-8406-66cc8eb8280c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1671 microversion: 2.1 time: 0.149809 Jul 27 04:31:47.858654 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 433/856] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:47 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:48.163890 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-233e4e44-62d8-4a4b-9cbc-ef5fafc5b885 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:48.164485 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-233e4e44-62d8-4a4b-9cbc-ef5fafc5b885 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:48.171206 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-233e4e44-62d8-4a4b-9cbc-ef5fafc5b885 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:48.171657 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-233e4e44-62d8-4a4b-9cbc-ef5fafc5b885 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:48.174103 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-233e4e44-62d8-4a4b-9cbc-ef5fafc5b885 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:48.174103 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-233e4e44-62d8-4a4b-9cbc-ef5fafc5b885 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:48.186688 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-233e4e44-62d8-4a4b-9cbc-ef5fafc5b885 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-233e4e44-62d8-4a4b-9cbc-ef5fafc5b885 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: DELETE /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 HTTP/1.1 Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:31:48.188363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:31:48.190549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:31:48.190549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:48.190549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:48.190549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:48.190549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:48.190549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:31:48.190549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:31:48.190549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:31:48.190549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:48.190549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:31:48.190549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:31:48.190549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '6df1d9b6-b48f-46d2-876e-dd6d14f70285'} Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:31:48.191433 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:31:48.193095 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:31:48.194698 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-233e4e44-62d8-4a4b-9cbc-ef5fafc5b885 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 404 to user: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:31:48.194698 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-233e4e44-62d8-4a4b-9cbc-ef5fafc5b885 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 404 len: 111 microversion: 2.1 time: 0.030727 Jul 27 04:31:48.194698 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 424/857] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:31:48 2022] DELETE /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:31:48.200053 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-956c77c3-f389-4ed7-a80f-cc3b9f855917 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:48.200677 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-956c77c3-f389-4ed7-a80f-cc3b9f855917 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] [instance: 6df1d9b6-b48f-46d2-876e-dd6d14f70285] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:48.208319 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-956c77c3-f389-4ed7-a80f-cc3b9f855917 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:48.209016 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-956c77c3-f389-4ed7-a80f-cc3b9f855917 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:48.210414 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-956c77c3-f389-4ed7-a80f-cc3b9f855917 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:48.211215 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-956c77c3-f389-4ed7-a80f-cc3b9f855917 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:48.227109 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-956c77c3-f389-4ed7-a80f-cc3b9f855917 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] HTTP exception thrown: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-956c77c3-f389-4ed7-a80f-cc3b9f855917 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Request method failure captured: Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 HTTP/1.1 Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L6cY1kk9sSP-jGyovDzY990jGGYr5FwnH6vEE6k8L8hoarQNMOzARgzC95dBvoS9PRtzwWMHK7rPIyrf59BLVSxRqAjiLbbkYuJ7Dl-AHbARcpRbFFiBPT99Lj9l4yf77RKE92dyefmGGb5jvnjXubT7mgVOaH_UazuDiq-Ar_6p5o Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:31:48.229163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:31:48.231038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa51c6088dfa44df848e339d61bac664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa51c6088dfa44df848e339d61bac664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:31:48.231038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:48.231038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: aa51c6088dfa44df848e339d61bac664 Jul 27 04:31:48.231038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-328071975 Jul 27 04:31:48.231038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:48.231038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:31:48.231038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:31:48.231038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 8cbc27f4433e4c48a75b216540a9022f Jul 27 04:31:48.231038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeNegativeTest-328071975-project Jul 27 04:31:48.231038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:31:48.231038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:31:48.231038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '6df1d9b6-b48f-46d2-876e-dd6d14f70285'} Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:31:48.231952 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. Jul 27 04:31:48.233456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:31:48.234765 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-956c77c3-f389-4ed7-a80f-cc3b9f855917 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] Returning 404 to user: Instance 6df1d9b6-b48f-46d2-876e-dd6d14f70285 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:31:48.234765 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-956c77c3-f389-4ed7-a80f-cc3b9f855917 tempest-AttachVolumeNegativeTest-328071975 tempest-AttachVolumeNegativeTest-328071975-project] 10.222.0.46 "GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285" status: 404 len: 111 microversion: 2.1 time: 0.034634 Jul 27 04:31:48.234765 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 434/858] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:48 2022] GET /compute/v2.1/servers/6df1d9b6-b48f-46d2-876e-dd6d14f70285 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 04:31:48.879232 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e6abfa75-6019-45a3-b7ac-5b3950ff6a73 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:48.879849 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e6abfa75-6019-45a3-b7ac-5b3950ff6a73 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:48.886262 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e6abfa75-6019-45a3-b7ac-5b3950ff6a73 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:48.886713 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e6abfa75-6019-45a3-b7ac-5b3950ff6a73 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:48.887485 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e6abfa75-6019-45a3-b7ac-5b3950ff6a73 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:48.887917 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e6abfa75-6019-45a3-b7ac-5b3950ff6a73 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:49.021297 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e6abfa75-6019-45a3-b7ac-5b3950ff6a73 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:49.030277 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e6abfa75-6019-45a3-b7ac-5b3950ff6a73 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1671 microversion: 2.1 time: 0.155012 Jul 27 04:31:49.030954 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 425/859] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:48 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:50.052687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9890efb8-250f-47ff-8410-612b8dbbb349 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:50.053296 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-9890efb8-250f-47ff-8410-612b8dbbb349 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:50.059709 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9890efb8-250f-47ff-8410-612b8dbbb349 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:50.060155 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9890efb8-250f-47ff-8410-612b8dbbb349 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:50.060924 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9890efb8-250f-47ff-8410-612b8dbbb349 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:50.061354 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9890efb8-250f-47ff-8410-612b8dbbb349 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:50.272383 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-9890efb8-250f-47ff-8410-612b8dbbb349 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:50.280559 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-9890efb8-250f-47ff-8410-612b8dbbb349 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1648 microversion: 2.1 time: 0.231583 Jul 27 04:31:50.281229 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 435/860] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:50 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1648 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:50.304438 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e4b8e571-5aec-4b07-a113-144e84d89b60 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:31:50.312099 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4b8e571-5aec-4b07-a113-144e84d89b60 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:50.313363 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4b8e571-5aec-4b07-a113-144e84d89b60 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:50.379168 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e4b8e571-5aec-4b07-a113-144e84d89b60 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Going to try to start instance {{(pid=117739) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 27 04:31:50.421104 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e4b8e571-5aec-4b07-a113-144e84d89b60 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "POST /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/action" status: 202 len: 0 microversion: 2.1 time: 0.122260 Jul 27 04:31:50.421775 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 426/861] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:31:50 2022] POST /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:31:50.429887 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4ed53a5b-a3f6-461d-b243-1e637b329d7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:50.430543 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4ed53a5b-a3f6-461d-b243-1e637b329d7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:50.436639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4ed53a5b-a3f6-461d-b243-1e637b329d7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:50.437091 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4ed53a5b-a3f6-461d-b243-1e637b329d7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:50.437926 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4ed53a5b-a3f6-461d-b243-1e637b329d7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:50.438372 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4ed53a5b-a3f6-461d-b243-1e637b329d7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:50.489853 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 04:31:50.490099 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Wed Jul 27 04:31:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 04:31:50.826819 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4ed53a5b-a3f6-461d-b243-1e637b329d7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:50.834816 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4ed53a5b-a3f6-461d-b243-1e637b329d7a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1657 microversion: 2.1 time: 0.408730 Jul 27 04:31:50.835501 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 436/862] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:50 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1657 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:31:51.861347 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4dd6d291-4978-43f3-8aa4-eadb2aaa6fb3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:31:51.862242 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4dd6d291-4978-43f3-8aa4-eadb2aaa6fb3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:31:51.864224 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:31:51.870598 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4dd6d291-4978-43f3-8aa4-eadb2aaa6fb3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:51.871297 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4dd6d291-4978-43f3-8aa4-eadb2aaa6fb3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:51.872565 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4dd6d291-4978-43f3-8aa4-eadb2aaa6fb3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:31:51.873079 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4dd6d291-4978-43f3-8aa4-eadb2aaa6fb3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:31:52.033331 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4dd6d291-4978-43f3-8aa4-eadb2aaa6fb3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:31:52.040878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4dd6d291-4978-43f3-8aa4-eadb2aaa6fb3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1661 microversion: 2.1 time: 0.187027 Jul 27 04:31:52.041455 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 427/863] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:31:51 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1661 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:16.868789 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1330443616", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "networks": [{"uuid": "d0ca4187-545d-4cfa-a361-aa212cd2f260"}]}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:16.877686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:16.878352 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=48 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:16.926300 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.network.neutron [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] validate_networks() for [('d0ca4187-545d-4cfa-a361-aa212cd2f260', None, None, None, None, None)] {{(pid=117740) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:32:17.277880 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Flavor limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:32:17.278336 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Image limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:32:17.278811 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Flavor pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:32:17.279217 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Image pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:32:17.279627 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:32:17.289753 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:17.290175 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:17.290974 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:17.291413 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:17.307794 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Getting quotas for project 37f8c051d2c14448ab9a73672f3f00a9. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:32:17.311714 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Getting quotas for user 69e9a87bc39f4456ab90586e02d0785d and project 37f8c051d2c14448ab9a73672f3f00a9. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:32:17.323536 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Going to run 1 instances... {{(pid=117740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:32:17.325723 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:32:17.370530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-98417318-d9aa-45b2-b974-2a0e5a26bf19 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506370 Jul 27 04:32:17.371163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 437/864] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:32:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:32:17.384588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-bbb62f20-652c-4939-86b6-ecab566e906a tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:17.385360 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-bbb62f20-652c-4939-86b6-ecab566e906a tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:17.387703 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:17.388748 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:17.485863 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-bbb62f20-652c-4939-86b6-ecab566e906a tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:17.493270 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-bbb62f20-652c-4939-86b6-ecab566e906a tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 200 len: 1214 microversion: 2.1 time: 0.115335 Jul 27 04:32:17.493834 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 428/865] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:17 2022] GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:18.515340 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-adfe5ff2-8179-4e07-8b85-a81d41260200 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:18.516380 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-adfe5ff2-8179-4e07-8b85-a81d41260200 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:18.524149 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-adfe5ff2-8179-4e07-8b85-a81d41260200 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:18.524588 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-adfe5ff2-8179-4e07-8b85-a81d41260200 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:18.525360 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-adfe5ff2-8179-4e07-8b85-a81d41260200 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:18.525790 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-adfe5ff2-8179-4e07-8b85-a81d41260200 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:18.593091 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-adfe5ff2-8179-4e07-8b85-a81d41260200 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:18.604439 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-adfe5ff2-8179-4e07-8b85-a81d41260200 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 200 len: 1284 microversion: 2.1 time: 0.092804 Jul 27 04:32:18.605648 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 438/866] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:18 2022] GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:32:19.626498 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4b6a56e8-2199-48f4-91c7-6df792f2f206 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:19.627117 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4b6a56e8-2199-48f4-91c7-6df792f2f206 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:19.633491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4b6a56e8-2199-48f4-91c7-6df792f2f206 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:19.633938 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4b6a56e8-2199-48f4-91c7-6df792f2f206 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:19.634738 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4b6a56e8-2199-48f4-91c7-6df792f2f206 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:19.635177 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4b6a56e8-2199-48f4-91c7-6df792f2f206 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:19.810511 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-4570793a-3897-4c5e-93ce-7957b0116428 req-216b0db4-f6b9-457e-a72a-e50701a9196c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e435139c-7888-41b5-91e0-a4266b07d3cf", "tag": "a31efb75-f9a5-40bf-83cb-785fadbd325d"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:19.823738 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-4570793a-3897-4c5e-93ce-7957b0116428 req-216b0db4-f6b9-457e-a72a-e50701a9196c service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:19.824275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-4570793a-3897-4c5e-93ce-7957b0116428 req-216b0db4-f6b9-457e-a72a-e50701a9196c service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:19.832932 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-4b6a56e8-2199-48f4-91c7-6df792f2f206 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:19.841256 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4b6a56e8-2199-48f4-91c7-6df792f2f206 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 200 len: 1314 microversion: 2.1 time: 0.218486 Jul 27 04:32:19.841886 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 429/867] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:19 2022] GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:19.864412 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-4570793a-3897-4c5e-93ce-7957b0116428 req-216b0db4-f6b9-457e-a72a-e50701a9196c service nova] Creating event network-changed:a31efb75-f9a5-40bf-83cb-785fadbd325d for instance e435139c-7888-41b5-91e0-a4266b07d3cf on hv-cinder-85098 Jul 27 04:32:19.869540 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-4570793a-3897-4c5e-93ce-7957b0116428 req-216b0db4-f6b9-457e-a72a-e50701a9196c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062799 Jul 27 04:32:19.870454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 439/868] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:32:20.863957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e4cc3775-2f55-42ab-b894-c02a8636c52f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:20.864638 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e4cc3775-2f55-42ab-b894-c02a8636c52f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:20.871013 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4cc3775-2f55-42ab-b894-c02a8636c52f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:20.871452 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4cc3775-2f55-42ab-b894-c02a8636c52f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:20.872205 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4cc3775-2f55-42ab-b894-c02a8636c52f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:20.872664 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4cc3775-2f55-42ab-b894-c02a8636c52f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:21.087343 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e4cc3775-2f55-42ab-b894-c02a8636c52f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:21.095114 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e4cc3775-2f55-42ab-b894-c02a8636c52f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 200 len: 1314 microversion: 2.1 time: 0.235482 Jul 27 04:32:21.095677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 430/869] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:20 2022] GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:22.117170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-273f77e9-ba25-4bc9-868b-1b668cab9ec8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:22.117854 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-273f77e9-ba25-4bc9-868b-1b668cab9ec8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:22.124429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-273f77e9-ba25-4bc9-868b-1b668cab9ec8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:22.124870 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-273f77e9-ba25-4bc9-868b-1b668cab9ec8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:22.125623 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-273f77e9-ba25-4bc9-868b-1b668cab9ec8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:22.126082 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-273f77e9-ba25-4bc9-868b-1b668cab9ec8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:22.255102 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-273f77e9-ba25-4bc9-868b-1b668cab9ec8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:22.262566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-273f77e9-ba25-4bc9-868b-1b668cab9ec8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 200 len: 1314 microversion: 2.1 time: 0.149857 Jul 27 04:32:22.263139 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 440/870] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:22 2022] GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:23.283523 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-a621cf64-da66-4524-8b38-112f12db1d38 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:23.284123 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-a621cf64-da66-4524-8b38-112f12db1d38 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:23.290593 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a621cf64-da66-4524-8b38-112f12db1d38 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:23.291030 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a621cf64-da66-4524-8b38-112f12db1d38 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:23.291778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a621cf64-da66-4524-8b38-112f12db1d38 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:23.292201 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a621cf64-da66-4524-8b38-112f12db1d38 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:23.417622 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-a621cf64-da66-4524-8b38-112f12db1d38 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:23.424902 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-a621cf64-da66-4524-8b38-112f12db1d38 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 200 len: 1314 microversion: 2.1 time: 0.145256 Jul 27 04:32:23.425458 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 431/871] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:23 2022] GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:24.446189 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3df3d923-cb8c-45a7-a58e-c53844e2f26c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:24.446801 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3df3d923-cb8c-45a7-a58e-c53844e2f26c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:24.453779 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3df3d923-cb8c-45a7-a58e-c53844e2f26c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:24.454248 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3df3d923-cb8c-45a7-a58e-c53844e2f26c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:24.455018 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3df3d923-cb8c-45a7-a58e-c53844e2f26c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:24.455445 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3df3d923-cb8c-45a7-a58e-c53844e2f26c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:24.588898 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3df3d923-cb8c-45a7-a58e-c53844e2f26c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:24.596358 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3df3d923-cb8c-45a7-a58e-c53844e2f26c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 200 len: 1314 microversion: 2.1 time: 0.154260 Jul 27 04:32:24.597110 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 441/872] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:24 2022] GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:24.676015 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-b26f8a3f-b4e1-40b1-988b-3f2eea78ad6e req-8a5026f7-35a6-48d8-ba06-0224a802ac8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e435139c-7888-41b5-91e0-a4266b07d3cf", "name": "network-vif-plugged", "status": "completed", "tag": "a31efb75-f9a5-40bf-83cb-785fadbd325d"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:24.689089 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-b26f8a3f-b4e1-40b1-988b-3f2eea78ad6e req-8a5026f7-35a6-48d8-ba06-0224a802ac8e service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:24.689534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-b26f8a3f-b4e1-40b1-988b-3f2eea78ad6e req-8a5026f7-35a6-48d8-ba06-0224a802ac8e service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:24.706039 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-b26f8a3f-b4e1-40b1-988b-3f2eea78ad6e req-8a5026f7-35a6-48d8-ba06-0224a802ac8e service nova] Creating event network-vif-plugged:a31efb75-f9a5-40bf-83cb-785fadbd325d for instance e435139c-7888-41b5-91e0-a4266b07d3cf on hv-cinder-85098 Jul 27 04:32:24.711537 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-b26f8a3f-b4e1-40b1-988b-3f2eea78ad6e req-8a5026f7-35a6-48d8-ba06-0224a802ac8e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039578 Jul 27 04:32:24.712139 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 432/873] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:32:24.826527 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-859529cc-7570-4910-8c59-abc5902b70b1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:24.828773 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-859529cc-7570-4910-8c59-abc5902b70b1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:24.835737 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-859529cc-7570-4910-8c59-abc5902b70b1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:24.836190 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-859529cc-7570-4910-8c59-abc5902b70b1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:24.836966 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-859529cc-7570-4910-8c59-abc5902b70b1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:24.837406 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-859529cc-7570-4910-8c59-abc5902b70b1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:24.868897 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-859529cc-7570-4910-8c59-abc5902b70b1 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046520 Jul 27 04:32:24.869470 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 442/874] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:32:24 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 04:32:24.935012 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-07cf6096-7674-4d94-84e4-5d2f0d24e91a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:24.935600 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-07cf6096-7674-4d94-84e4-5d2f0d24e91a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:24.941773 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-07cf6096-7674-4d94-84e4-5d2f0d24e91a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:24.942250 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-07cf6096-7674-4d94-84e4-5d2f0d24e91a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:24.943045 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-07cf6096-7674-4d94-84e4-5d2f0d24e91a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:24.943481 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-07cf6096-7674-4d94-84e4-5d2f0d24e91a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:24.967800 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-07cf6096-7674-4d94-84e4-5d2f0d24e91a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Going to try to terminate instance {{(pid=117739) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:32:25.040127 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-07cf6096-7674-4d94-84e4-5d2f0d24e91a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "DELETE /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 204 len: 0 microversion: 2.1 time: 0.109100 Jul 27 04:32:25.040680 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 433/875] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:32:24 2022] DELETE /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:32:25.049525 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-62e102bc-76a1-4cbc-a6f7-d982208ca496 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:25.050169 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-62e102bc-76a1-4cbc-a6f7-d982208ca496 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:25.057224 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-62e102bc-76a1-4cbc-a6f7-d982208ca496 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:25.057675 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-62e102bc-76a1-4cbc-a6f7-d982208ca496 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:25.058479 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-62e102bc-76a1-4cbc-a6f7-d982208ca496 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:25.058918 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-62e102bc-76a1-4cbc-a6f7-d982208ca496 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:25.194049 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-62e102bc-76a1-4cbc-a6f7-d982208ca496 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:25.201685 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-62e102bc-76a1-4cbc-a6f7-d982208ca496 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1667 microversion: 2.1 time: 0.156390 Jul 27 04:32:25.202289 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 443/876] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:25 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:25.619303 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-330900ed-62f8-4c70-854e-28e50ed08542 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:25.619997 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-330900ed-62f8-4c70-854e-28e50ed08542 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:25.625872 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-330900ed-62f8-4c70-854e-28e50ed08542 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:25.626349 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-330900ed-62f8-4c70-854e-28e50ed08542 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:25.627096 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-330900ed-62f8-4c70-854e-28e50ed08542 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:25.627523 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-330900ed-62f8-4c70-854e-28e50ed08542 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:25.760767 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-330900ed-62f8-4c70-854e-28e50ed08542 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:25.768153 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-330900ed-62f8-4c70-854e-28e50ed08542 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 200 len: 1314 microversion: 2.1 time: 0.153049 Jul 27 04:32:25.768750 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 434/877] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:25 2022] GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:26.223270 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-cc50561a-9eda-4d76-9c99-b09078d4637a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:26.223894 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-cc50561a-9eda-4d76-9c99-b09078d4637a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:26.230290 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cc50561a-9eda-4d76-9c99-b09078d4637a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:26.230739 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cc50561a-9eda-4d76-9c99-b09078d4637a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:26.231501 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cc50561a-9eda-4d76-9c99-b09078d4637a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:26.232511 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-cc50561a-9eda-4d76-9c99-b09078d4637a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:26.360365 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-cc50561a-9eda-4d76-9c99-b09078d4637a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:26.368005 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-cc50561a-9eda-4d76-9c99-b09078d4637a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1667 microversion: 2.1 time: 0.148937 Jul 27 04:32:26.368565 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 444/878] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:26 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1667 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:26.789143 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-a4d2b039-d7b5-41d8-a672-6da176e898ce tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:26.789756 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-a4d2b039-d7b5-41d8-a672-6da176e898ce tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:26.796231 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a4d2b039-d7b5-41d8-a672-6da176e898ce tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:26.796677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a4d2b039-d7b5-41d8-a672-6da176e898ce tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:26.797437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a4d2b039-d7b5-41d8-a672-6da176e898ce tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:26.797872 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-a4d2b039-d7b5-41d8-a672-6da176e898ce tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:26.927810 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-a4d2b039-d7b5-41d8-a672-6da176e898ce tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:26.935219 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-a4d2b039-d7b5-41d8-a672-6da176e898ce tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 200 len: 1314 microversion: 2.1 time: 0.150528 Jul 27 04:32:26.935796 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 435/879] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:26 2022] GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:27.389616 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b5e984f8-9435-4522-916c-39a4183394f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:27.390344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b5e984f8-9435-4522-916c-39a4183394f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:27.392720 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:27.393661 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=6 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:27.399442 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b5e984f8-9435-4522-916c-39a4183394f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:27.399888 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b5e984f8-9435-4522-916c-39a4183394f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:27.400650 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b5e984f8-9435-4522-916c-39a4183394f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:27.401093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b5e984f8-9435-4522-916c-39a4183394f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:27.533389 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b5e984f8-9435-4522-916c-39a4183394f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:27.541183 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b5e984f8-9435-4522-916c-39a4183394f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1667 microversion: 2.1 time: 0.155449 Jul 27 04:32:27.541755 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 445/880] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:27 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:27.956524 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-32482540-c6fe-4d9f-ab43-8ba522a96357 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:27.957771 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-32482540-c6fe-4d9f-ab43-8ba522a96357 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:27.959699 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:27.965586 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-32482540-c6fe-4d9f-ab43-8ba522a96357 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:27.966061 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-32482540-c6fe-4d9f-ab43-8ba522a96357 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:27.966827 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-32482540-c6fe-4d9f-ab43-8ba522a96357 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:27.967257 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-32482540-c6fe-4d9f-ab43-8ba522a96357 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:28.130679 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-955a3162-d55b-4810-a796-dd7f3c7e40de req-647ef7cf-8b1b-4c18-aca0-57612130b392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066cbb5b-1fe9-4c3d-b721-8962ce4f9b53", "name": "network-vif-deleted", "tag": "24147a21-2fff-4b3f-acae-bcae05c1ad81"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:28.140869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-955a3162-d55b-4810-a796-dd7f3c7e40de req-647ef7cf-8b1b-4c18-aca0-57612130b392 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:28.141340 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-955a3162-d55b-4810-a796-dd7f3c7e40de req-647ef7cf-8b1b-4c18-aca0-57612130b392 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:28.155363 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-955a3162-d55b-4810-a796-dd7f3c7e40de req-647ef7cf-8b1b-4c18-aca0-57612130b392 service nova] Creating event network-vif-deleted:24147a21-2fff-4b3f-acae-bcae05c1ad81 for instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 on hv-cinder-85098 Jul 27 04:32:28.161505 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-955a3162-d55b-4810-a796-dd7f3c7e40de req-647ef7cf-8b1b-4c18-aca0-57612130b392 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035449 Jul 27 04:32:28.162556 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 446/881] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:32:28.162719 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-32482540-c6fe-4d9f-ab43-8ba522a96357 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:28.172168 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-32482540-c6fe-4d9f-ab43-8ba522a96357 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 200 len: 1497 microversion: 2.1 time: 0.219398 Jul 27 04:32:28.173409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 436/882] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:27 2022] GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 1497 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:28.564008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-5ed59ed3-0bdc-42c2-a5e3-1432da878c49 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:28.564713 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-5ed59ed3-0bdc-42c2-a5e3-1432da878c49 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:28.575729 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ed59ed3-0bdc-42c2-a5e3-1432da878c49 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:28.576219 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ed59ed3-0bdc-42c2-a5e3-1432da878c49 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:28.577007 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ed59ed3-0bdc-42c2-a5e3-1432da878c49 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:28.577648 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ed59ed3-0bdc-42c2-a5e3-1432da878c49 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:28.614857 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-fee8d8e7-c059-419b-b1c2-7f3ff700ce96 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:28.615798 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-fee8d8e7-c059-419b-b1c2-7f3ff700ce96 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:28.624178 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fee8d8e7-c059-419b-b1c2-7f3ff700ce96 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:28.625064 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fee8d8e7-c059-419b-b1c2-7f3ff700ce96 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:28.626169 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fee8d8e7-c059-419b-b1c2-7f3ff700ce96 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:28.627526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fee8d8e7-c059-419b-b1c2-7f3ff700ce96 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:28.631504 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ed59ed3-0bdc-42c2-a5e3-1432da878c49 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:28.631960 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-5ed59ed3-0bdc-42c2-a5e3-1432da878c49 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:28.632499 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-5ed59ed3-0bdc-42c2-a5e3-1432da878c49 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lazy-loading 'fault' on Instance uuid 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:32:28.664372 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-fee8d8e7-c059-419b-b1c2-7f3ff700ce96 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Going to try to terminate instance {{(pid=117739) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:32:28.688417 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-5ed59ed3-0bdc-42c2-a5e3-1432da878c49 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:28.696210 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-5ed59ed3-0bdc-42c2-a5e3-1432da878c49 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 200 len: 1326 microversion: 2.1 time: 0.136886 Jul 27 04:32:28.696787 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 447/883] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:28 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 1326 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:28.762773 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-fee8d8e7-c059-419b-b1c2-7f3ff700ce96 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 204 len: 0 microversion: 2.1 time: 0.152803 Jul 27 04:32:28.763674 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 437/884] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:32:28 2022] DELETE /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 04:32:28.772189 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c39cc743-06a5-46c4-819e-9664045a3003 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:28.772814 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c39cc743-06a5-46c4-819e-9664045a3003 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:28.778825 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c39cc743-06a5-46c4-819e-9664045a3003 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:28.779278 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c39cc743-06a5-46c4-819e-9664045a3003 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:28.780057 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c39cc743-06a5-46c4-819e-9664045a3003 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:28.780498 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c39cc743-06a5-46c4-819e-9664045a3003 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:28.911041 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-c39cc743-06a5-46c4-819e-9664045a3003 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:28.918440 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c39cc743-06a5-46c4-819e-9664045a3003 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 200 len: 1503 microversion: 2.1 time: 0.150296 Jul 27 04:32:28.919039 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 448/885] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:28 2022] GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:32:29.720473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7b884654-95ff-486c-be34-7bd75febc560 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:29.721092 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-7b884654-95ff-486c-be34-7bd75febc560 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:29.728324 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7b884654-95ff-486c-be34-7bd75febc560 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:29.728763 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7b884654-95ff-486c-be34-7bd75febc560 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:29.729511 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7b884654-95ff-486c-be34-7bd75febc560 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:29.729938 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7b884654-95ff-486c-be34-7bd75febc560 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:29.743368 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-7b884654-95ff-486c-be34-7bd75febc560 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] HTTP exception thrown: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7b884654-95ff-486c-be34-7bd75febc560 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Request method failure captured: Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 HTTP/1.1 Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L8lfBkhfp4AJB-WxfQ8D_SBWJjTjDXU_wYuavVUzqVjCKqjJ9I4J6KS0oT7IaxU2VnC8Rz5k6u26eyHGH6MvS8OkE4MD-XwbNsqU5A5f-DHxSyA7JqsyslTUgyBjq-FiZJ_VNKVQealvM-K6UE4EMQMIL2SqXyz93cmkLaVQxDi8wE Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: e51f9e52588e4008adf20f443c367b02 Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:32:29.744937 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:32:29.746656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e51f9e52588e4008adf20f443c367b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:32:29.746656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:32:29.746656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: e51f9e52588e4008adf20f443c367b02 Jul 27 04:32:29.746656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:32:29.746656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-AttachVolumeTestJSON-1412373030-project Jul 27 04:32:29.746656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:32:29.746656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:32:29.746656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 89aa18ddc71c4951bf15fcbd404912e9 Jul 27 04:32:29.746656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-AttachVolumeTestJSON-1412373030-project Jul 27 04:32:29.746656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:32:29.746656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:32:29.746656 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '066cbb5b-1fe9-4c3d-b721-8962ce4f9b53'} Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:32:29.747816 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:32:29.749409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:32:29.750941 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7b884654-95ff-486c-be34-7bd75febc560 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Returning 404 to user: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:32:29.750941 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-7b884654-95ff-486c-be34-7bd75febc560 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 404 len: 111 microversion: 2.1 time: 0.030057 Jul 27 04:32:29.750941 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 438/886] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:29 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:32:29.755065 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f2d0026e-a6ba-4bc2-a3bb-0073645ed2fb tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '.version_select at 0x7f21d5a263a0>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:29.773734 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f2d0026e-a6ba-4bc2-a3bb-0073645ed2fb tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-550567146" status: 202 len: 0 microversion: 2.1 time: 0.022500 Jul 27 04:32:29.774311 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 449/887] 10.222.0.46 () {58 vars in 1218 bytes} [Wed Jul 27 04:32:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-550567146 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 04:32:29.939358 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2830c8f4-969c-490b-ba48-8951a80ff0fa tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:29.940341 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2830c8f4-969c-490b-ba48-8951a80ff0fa tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:29.947502 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2830c8f4-969c-490b-ba48-8951a80ff0fa tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:29.948226 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2830c8f4-969c-490b-ba48-8951a80ff0fa tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:29.949618 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2830c8f4-969c-490b-ba48-8951a80ff0fa tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:29.950673 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2830c8f4-969c-490b-ba48-8951a80ff0fa tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:30.152892 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2830c8f4-969c-490b-ba48-8951a80ff0fa tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:30.163248 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2830c8f4-969c-490b-ba48-8951a80ff0fa tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 200 len: 1503 microversion: 2.1 time: 0.227679 Jul 27 04:32:30.164033 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 439/888] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:29 2022] GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:30.397405 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-74e7601f-8965-4b17-b09b-587dd8471d60 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Action: 'create', calling method: .version_select at 0x7f21d59fe310>, body: {"keypair": {"name": "tempest-keypair-290216017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENVGukWoB0U+OZwLAoVZ0yFDfa+B6t2K4v/0EH0Im2/iNC64v8VU08CpCu/YZb4ZxoLhHbvojKr33+ENh8vfHRY1MkJ0xGmiz9tEZ+O6hSfOJ/n4joAW55/PhRETK8ZaA=="}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:30.414156 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-74e7601f-8965-4b17-b09b-587dd8471d60 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Getting quotas for project e51f9e52588e4008adf20f443c367b02. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:32:30.418096 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-74e7601f-8965-4b17-b09b-587dd8471d60 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Getting quotas for user 89aa18ddc71c4951bf15fcbd404912e9 and project e51f9e52588e4008adf20f443c367b02. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:32:30.441828 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-74e7601f-8965-4b17-b09b-587dd8471d60 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049036 Jul 27 04:32:30.449385 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 450/889] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Jul 27 04:32:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:32:30.539281 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-a4e26e7d-96bf-4829-a7d4-5d5720b31d89 req-48070f90-c65e-4f9e-898d-4e7e84e2ca0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e435139c-7888-41b5-91e0-a4266b07d3cf", "name": "network-vif-deleted", "tag": "a31efb75-f9a5-40bf-83cb-785fadbd325d"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:30.552312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-a4e26e7d-96bf-4829-a7d4-5d5720b31d89 req-48070f90-c65e-4f9e-898d-4e7e84e2ca0d service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:30.552842 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-a4e26e7d-96bf-4829-a7d4-5d5720b31d89 req-48070f90-c65e-4f9e-898d-4e7e84e2ca0d service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:30.566708 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-a4e26e7d-96bf-4829-a7d4-5d5720b31d89 req-48070f90-c65e-4f9e-898d-4e7e84e2ca0d service nova] Creating event network-vif-deleted:a31efb75-f9a5-40bf-83cb-785fadbd325d for instance e435139c-7888-41b5-91e0-a4266b07d3cf on hv-cinder-85098 Jul 27 04:32:30.573009 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-a4e26e7d-96bf-4829-a7d4-5d5720b31d89 req-48070f90-c65e-4f9e-898d-4e7e84e2ca0d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038999 Jul 27 04:32:30.574213 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 440/890] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:32:31.184971 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0edadb4c-2ad3-46a9-a5ab-c85fa88e17fe tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:31.185596 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0edadb4c-2ad3-46a9-a5ab-c85fa88e17fe tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: e435139c-7888-41b5-91e0-a4266b07d3cf] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:31.192817 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0edadb4c-2ad3-46a9-a5ab-c85fa88e17fe tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:31.193271 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0edadb4c-2ad3-46a9-a5ab-c85fa88e17fe tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:31.194139 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0edadb4c-2ad3-46a9-a5ab-c85fa88e17fe tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:31.194580 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0edadb4c-2ad3-46a9-a5ab-c85fa88e17fe tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:31.209305 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-0edadb4c-2ad3-46a9-a5ab-c85fa88e17fe tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] HTTP exception thrown: Instance e435139c-7888-41b5-91e0-a4266b07d3cf could not be found. Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0edadb4c-2ad3-46a9-a5ab-c85fa88e17fe tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Request method failure captured: Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf HTTP/1.1 Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L_P8Tw4-AepRdlDf1n4M7TxwlU6EpweZl28z4K7Js3TRSqM-TK87U-l7RIc3Ju04iMGzhA6XDLOAzJoJ7jxuPEYOgc9CWF5GmrZXiALiZlZq44tLHHlV4NVmSIzys75KHwrHReAvY97on5m8BiFIOAF9hbY4S8CzVIMnVwD2iHEaUs Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 37f8c051d2c14448ab9a73672f3f00a9 Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-VolumesActionsTest-1302665209 Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:32:31.210994 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:32:31.212510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/37f8c051d2c14448ab9a73672f3f00a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/37f8c051d2c14448ab9a73672f3f00a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/37f8c051d2c14448ab9a73672f3f00a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_37f8c051d2c14448ab9a73672f3f00a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:32:31.212510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-VolumesActionsTest-1302665209 Jul 27 04:32:31.212510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 37f8c051d2c14448ab9a73672f3f00a9 Jul 27 04:32:31.212510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-VolumesActionsTest-1302665209 Jul 27 04:32:31.212510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-VolumesActionsTest-1302665209-project Jul 27 04:32:31.212510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:32:31.212510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:32:31.212510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 69e9a87bc39f4456ab90586e02d0785d Jul 27 04:32:31.212510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-VolumesActionsTest-1302665209-project Jul 27 04:32:31.212510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:32:31.212510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance e435139c-7888-41b5-91e0-a4266b07d3cf could not be found. Jul 27 04:32:31.212510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': 'e435139c-7888-41b5-91e0-a4266b07d3cf'} Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e435139c-7888-41b5-91e0-a4266b07d3cf could not be found. Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:32:31.213361 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e435139c-7888-41b5-91e0-a4266b07d3cf could not be found. Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e435139c-7888-41b5-91e0-a4266b07d3cf could not be found. Jul 27 04:32:31.214653 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:32:31.215783 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0edadb4c-2ad3-46a9-a5ab-c85fa88e17fe tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Returning 404 to user: Instance e435139c-7888-41b5-91e0-a4266b07d3cf could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:32:31.215783 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0edadb4c-2ad3-46a9-a5ab-c85fa88e17fe tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf" status: 404 len: 111 microversion: 2.1 time: 0.031636 Jul 27 04:32:31.215783 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 451/891] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:31 2022] GET /compute/v2.1/servers/e435139c-7888-41b5-91e0-a4266b07d3cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:32:31.265345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1132327020", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "networks": [{"uuid": "d0ca4187-545d-4cfa-a361-aa212cd2f260"}]}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:31.321480 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] validate_networks() for [('d0ca4187-545d-4cfa-a361-aa212cd2f260', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:32:31.740105 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:32:31.740549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:32:31.741024 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:32:31.741428 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:32:31.741868 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:32:31.750623 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:31.751068 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:31.751874 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:31.752306 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:31.769870 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Getting quotas for project 37f8c051d2c14448ab9a73672f3f00a9. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:32:31.774224 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Getting quotas for user 69e9a87bc39f4456ab90586e02d0785d and project 37f8c051d2c14448ab9a73672f3f00a9. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:32:31.775881 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-121085075", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5197559e-44b6-4dfe-9129-b0dbe7bd10f1"}], "security_groups": [{"name": "tempest-securitygroup--1859962017"}], "key_name": "tempest-keypair-290216017", "user_data": "}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:31.785739 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:32:31.788146 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:32:31.834454 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d97f31f5-2c08-459f-a304-4d154d5e9091 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573419 Jul 27 04:32:31.835392 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 441/892] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:32:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:32:31.846427 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9b2ae5fe-8005-4c0f-ac51-6cae5aac5f7b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:31.847335 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9b2ae5fe-8005-4c0f-ac51-6cae5aac5f7b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:31.900732 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.network.neutron [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] validate_networks() for [('5197559e-44b6-4dfe-9129-b0dbe7bd10f1', None, None, None, None, None)] {{(pid=117740) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:32:31.912163 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9b2ae5fe-8005-4c0f-ac51-6cae5aac5f7b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:31.919819 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9b2ae5fe-8005-4c0f-ac51-6cae5aac5f7b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99" status: 200 len: 1214 microversion: 2.1 time: 0.077584 Jul 27 04:32:31.920371 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 442/893] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:31 2022] GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:32:32.286481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Flavor limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:32:32.287576 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Image limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:32:32.288056 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Flavor pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:32:32.288464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Image pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:32:32.288890 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:32:32.297773 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:32.298251 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:32.299049 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:32.299514 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:32.316896 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Getting quotas for project e51f9e52588e4008adf20f443c367b02. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:32:32.320980 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Getting quotas for user 89aa18ddc71c4951bf15fcbd404912e9 and project e51f9e52588e4008adf20f443c367b02. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:32:32.332876 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Going to run 1 instances... {{(pid=117740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:32:32.335153 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:32:32.380976 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-28bbfdd0-ab0f-4d57-b96c-718a0c2ea901 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.609322 Jul 27 04:32:32.381807 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 452/894] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:32:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 04:32:32.392620 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d9e156fd-21cc-4566-9a7e-908c641c840f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:32.393235 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d9e156fd-21cc-4566-9a7e-908c641c840f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:32.452368 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d9e156fd-21cc-4566-9a7e-908c641c840f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:32.464396 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d9e156fd-21cc-4566-9a7e-908c641c840f tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1236 microversion: 2.1 time: 0.075395 Jul 27 04:32:32.466057 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 443/895] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:32 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1236 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:32:32.940696 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-32e2c2cb-bab3-40f0-89c8-a3bcc81ac78b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:32.941622 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-32e2c2cb-bab3-40f0-89c8-a3bcc81ac78b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:32.950645 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-32e2c2cb-bab3-40f0-89c8-a3bcc81ac78b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:32.951131 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-32e2c2cb-bab3-40f0-89c8-a3bcc81ac78b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:32.951960 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-32e2c2cb-bab3-40f0-89c8-a3bcc81ac78b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:32.952634 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-32e2c2cb-bab3-40f0-89c8-a3bcc81ac78b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:33.021183 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-32e2c2cb-bab3-40f0-89c8-a3bcc81ac78b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:33.030912 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-32e2c2cb-bab3-40f0-89c8-a3bcc81ac78b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99" status: 200 len: 1272 microversion: 2.1 time: 0.094064 Jul 27 04:32:33.031793 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 453/896] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:32 2022] GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:33.490014 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9658b21c-f961-449f-aa75-366c4f8cc216 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:33.495301 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9658b21c-f961-449f-aa75-366c4f8cc216 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:33.503681 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9658b21c-f961-449f-aa75-366c4f8cc216 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:33.505226 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9658b21c-f961-449f-aa75-366c4f8cc216 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:33.506121 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9658b21c-f961-449f-aa75-366c4f8cc216 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:33.506612 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9658b21c-f961-449f-aa75-366c4f8cc216 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:33.582877 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9658b21c-f961-449f-aa75-366c4f8cc216 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:33.594312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9658b21c-f961-449f-aa75-366c4f8cc216 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1294 microversion: 2.1 time: 0.112131 Jul 27 04:32:33.595471 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 444/897] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:33 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1294 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:34.053313 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-381d29ae-5113-49dd-a1ed-db878fe06c90 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:34.053927 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-381d29ae-5113-49dd-a1ed-db878fe06c90 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:34.060413 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-381d29ae-5113-49dd-a1ed-db878fe06c90 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:34.060867 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-381d29ae-5113-49dd-a1ed-db878fe06c90 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:34.061658 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-381d29ae-5113-49dd-a1ed-db878fe06c90 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:34.062101 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-381d29ae-5113-49dd-a1ed-db878fe06c90 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:34.144504 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-75e774ce-f7f6-4f84-b2aa-d4bd934cc6f1 req-26742c46-4045-404f-9a42-11714af036ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a68669a-49bb-4a22-bd5b-9801e50a6d99", "tag": "0a92b684-aab1-4972-86be-c1a6a1b54eb0"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:34.157484 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-75e774ce-f7f6-4f84-b2aa-d4bd934cc6f1 req-26742c46-4045-404f-9a42-11714af036ba service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:34.162702 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-75e774ce-f7f6-4f84-b2aa-d4bd934cc6f1 req-26742c46-4045-404f-9a42-11714af036ba service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:34.179211 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-75e774ce-f7f6-4f84-b2aa-d4bd934cc6f1 req-26742c46-4045-404f-9a42-11714af036ba service nova] Creating event network-changed:0a92b684-aab1-4972-86be-c1a6a1b54eb0 for instance 9a68669a-49bb-4a22-bd5b-9801e50a6d99 on hv-cinder-85098 Jul 27 04:32:34.184394 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-75e774ce-f7f6-4f84-b2aa-d4bd934cc6f1 req-26742c46-4045-404f-9a42-11714af036ba service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044559 Jul 27 04:32:34.185090 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 445/898] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:32:34.318207 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-381d29ae-5113-49dd-a1ed-db878fe06c90 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:34.326101 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-381d29ae-5113-49dd-a1ed-db878fe06c90 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99" status: 200 len: 1314 microversion: 2.1 time: 0.277262 Jul 27 04:32:34.326664 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 454/899] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:34 2022] GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:34.618021 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d0c239ae-f59c-4cfa-b91a-97b62dd9d4ea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:34.618738 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d0c239ae-f59c-4cfa-b91a-97b62dd9d4ea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:34.625584 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d0c239ae-f59c-4cfa-b91a-97b62dd9d4ea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:34.626465 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d0c239ae-f59c-4cfa-b91a-97b62dd9d4ea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:34.627567 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d0c239ae-f59c-4cfa-b91a-97b62dd9d4ea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:34.627826 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d0c239ae-f59c-4cfa-b91a-97b62dd9d4ea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:34.761448 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d0c239ae-f59c-4cfa-b91a-97b62dd9d4ea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:34.769052 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d0c239ae-f59c-4cfa-b91a-97b62dd9d4ea tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1362 microversion: 2.1 time: 0.156028 Jul 27 04:32:34.770399 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 446/900] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:34 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:35.185078 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-62c455e4-5dcb-4083-9a6f-67687949fffb req-8757d8e9-2d47-4a6c-9636-a4c4cd5f2cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0d21bc-cb26-4062-92ef-e03a680c90c0", "tag": "5349185d-2368-47e0-8150-20b7da691812"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:35.195255 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-62c455e4-5dcb-4083-9a6f-67687949fffb req-8757d8e9-2d47-4a6c-9636-a4c4cd5f2cb6 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:35.195707 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-62c455e4-5dcb-4083-9a6f-67687949fffb req-8757d8e9-2d47-4a6c-9636-a4c4cd5f2cb6 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:35.206839 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-62c455e4-5dcb-4083-9a6f-67687949fffb req-8757d8e9-2d47-4a6c-9636-a4c4cd5f2cb6 service nova] Creating event network-changed:5349185d-2368-47e0-8150-20b7da691812 for instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 on hv-cinder-85098 Jul 27 04:32:35.212197 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-62c455e4-5dcb-4083-9a6f-67687949fffb req-8757d8e9-2d47-4a6c-9636-a4c4cd5f2cb6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159500 Jul 27 04:32:35.212774 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 455/901] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:32:35.347467 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e5f301a8-b056-4382-a8da-f42b72d2c5e7 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:35.348123 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e5f301a8-b056-4382-a8da-f42b72d2c5e7 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:35.354437 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e5f301a8-b056-4382-a8da-f42b72d2c5e7 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:35.355141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e5f301a8-b056-4382-a8da-f42b72d2c5e7 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:35.355955 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e5f301a8-b056-4382-a8da-f42b72d2c5e7 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:35.356542 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e5f301a8-b056-4382-a8da-f42b72d2c5e7 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:35.386593 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:35.594507 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e5f301a8-b056-4382-a8da-f42b72d2c5e7 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:35.609826 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e5f301a8-b056-4382-a8da-f42b72d2c5e7 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99" status: 200 len: 1314 microversion: 2.1 time: 0.266193 Jul 27 04:32:35.623887 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 447/902] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:35 2022] GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:35.790421 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-31dd68ad-d824-44c0-a2ef-78e563b41a20 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:35.791128 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-31dd68ad-d824-44c0-a2ef-78e563b41a20 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:35.797410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-31dd68ad-d824-44c0-a2ef-78e563b41a20 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:35.797870 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-31dd68ad-d824-44c0-a2ef-78e563b41a20 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:35.798675 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-31dd68ad-d824-44c0-a2ef-78e563b41a20 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:35.799117 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-31dd68ad-d824-44c0-a2ef-78e563b41a20 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:35.930036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-31dd68ad-d824-44c0-a2ef-78e563b41a20 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:35.937461 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-31dd68ad-d824-44c0-a2ef-78e563b41a20 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1362 microversion: 2.1 time: 0.151349 Jul 27 04:32:35.938270 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 456/903] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:35 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:36.632110 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e4f683ce-4246-4939-a44c-d977b676bb3b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:36.632711 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e4f683ce-4246-4939-a44c-d977b676bb3b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:36.639148 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4f683ce-4246-4939-a44c-d977b676bb3b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:36.639588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4f683ce-4246-4939-a44c-d977b676bb3b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:36.640344 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4f683ce-4246-4939-a44c-d977b676bb3b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:36.640768 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e4f683ce-4246-4939-a44c-d977b676bb3b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:36.928316 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e4f683ce-4246-4939-a44c-d977b676bb3b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:36.935791 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e4f683ce-4246-4939-a44c-d977b676bb3b tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99" status: 200 len: 1314 microversion: 2.1 time: 0.308209 Jul 27 04:32:36.936344 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 448/904] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:36 2022] GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:32:36.958310 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-dd6057fe-8044-4a4d-a4e4-9b7d1a9a0df9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:36.958921 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-dd6057fe-8044-4a4d-a4e4-9b7d1a9a0df9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:36.965409 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dd6057fe-8044-4a4d-a4e4-9b7d1a9a0df9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:36.965787 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dd6057fe-8044-4a4d-a4e4-9b7d1a9a0df9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:36.966596 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dd6057fe-8044-4a4d-a4e4-9b7d1a9a0df9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:36.967029 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dd6057fe-8044-4a4d-a4e4-9b7d1a9a0df9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:37.101514 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-dd6057fe-8044-4a4d-a4e4-9b7d1a9a0df9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:37.108904 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-dd6057fe-8044-4a4d-a4e4-9b7d1a9a0df9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1362 microversion: 2.1 time: 0.154412 Jul 27 04:32:37.109458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 457/905] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:36 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:32:37.956702 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-db5b706c-2c81-4ca2-978e-15799074b9b8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:37.957332 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-db5b706c-2c81-4ca2-978e-15799074b9b8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:37.964022 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-db5b706c-2c81-4ca2-978e-15799074b9b8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:37.964470 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-db5b706c-2c81-4ca2-978e-15799074b9b8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:37.965234 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-db5b706c-2c81-4ca2-978e-15799074b9b8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:37.965670 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-db5b706c-2c81-4ca2-978e-15799074b9b8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:38.090062 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-db5b706c-2c81-4ca2-978e-15799074b9b8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:38.097373 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-db5b706c-2c81-4ca2-978e-15799074b9b8 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99" status: 200 len: 1314 microversion: 2.1 time: 0.144595 Jul 27 04:32:38.098441 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 449/906] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:37 2022] GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:38.130284 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-80439d07-e227-4243-a8fc-651072ee964b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:38.130895 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-80439d07-e227-4243-a8fc-651072ee964b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:38.137225 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-80439d07-e227-4243-a8fc-651072ee964b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:38.137667 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-80439d07-e227-4243-a8fc-651072ee964b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:38.138464 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-80439d07-e227-4243-a8fc-651072ee964b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:38.138905 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-80439d07-e227-4243-a8fc-651072ee964b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:38.265405 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-80439d07-e227-4243-a8fc-651072ee964b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:38.273918 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-80439d07-e227-4243-a8fc-651072ee964b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1362 microversion: 2.1 time: 0.147997 Jul 27 04:32:38.274508 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 458/907] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:38 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:38.957209 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-8f658ac8-0aa4-4457-b79a-1a9daa098b32 req-598be462-50f9-4339-a13d-95fa8685b1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a68669a-49bb-4a22-bd5b-9801e50a6d99", "name": "network-vif-plugged", "status": "completed", "tag": "0a92b684-aab1-4972-86be-c1a6a1b54eb0"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:38.967066 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-8f658ac8-0aa4-4457-b79a-1a9daa098b32 req-598be462-50f9-4339-a13d-95fa8685b1e1 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:38.967495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-8f658ac8-0aa4-4457-b79a-1a9daa098b32 req-598be462-50f9-4339-a13d-95fa8685b1e1 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:38.981579 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-8f658ac8-0aa4-4457-b79a-1a9daa098b32 req-598be462-50f9-4339-a13d-95fa8685b1e1 service nova] Creating event network-vif-plugged:0a92b684-aab1-4972-86be-c1a6a1b54eb0 for instance 9a68669a-49bb-4a22-bd5b-9801e50a6d99 on hv-cinder-85098 Jul 27 04:32:38.986379 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-8f658ac8-0aa4-4457-b79a-1a9daa098b32 req-598be462-50f9-4339-a13d-95fa8685b1e1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100238 Jul 27 04:32:38.986966 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 450/908] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:32:39.118844 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-d18d2891-4f61-4a7a-b2ec-0eb094ddc09f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:39.119500 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-d18d2891-4f61-4a7a-b2ec-0eb094ddc09f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:39.125665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d18d2891-4f61-4a7a-b2ec-0eb094ddc09f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:39.126154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d18d2891-4f61-4a7a-b2ec-0eb094ddc09f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:39.126932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d18d2891-4f61-4a7a-b2ec-0eb094ddc09f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:39.127371 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-d18d2891-4f61-4a7a-b2ec-0eb094ddc09f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:39.132045 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=100 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:39.269093 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-d18d2891-4f61-4a7a-b2ec-0eb094ddc09f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:39.276955 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-d18d2891-4f61-4a7a-b2ec-0eb094ddc09f tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99" status: 200 len: 1314 microversion: 2.1 time: 0.162039 Jul 27 04:32:39.277526 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 459/909] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:39 2022] GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:32:39.295355 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-43b2cd58-be4a-49d5-a5db-cae08235cda0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:39.296046 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-43b2cd58-be4a-49d5-a5db-cae08235cda0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:39.302823 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-43b2cd58-be4a-49d5-a5db-cae08235cda0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:39.303268 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-43b2cd58-be4a-49d5-a5db-cae08235cda0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:39.304021 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-43b2cd58-be4a-49d5-a5db-cae08235cda0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:39.304454 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-43b2cd58-be4a-49d5-a5db-cae08235cda0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:39.431938 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-43b2cd58-be4a-49d5-a5db-cae08235cda0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:39.439187 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-43b2cd58-be4a-49d5-a5db-cae08235cda0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1362 microversion: 2.1 time: 0.147966 Jul 27 04:32:39.439734 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 451/910] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:39 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:40.298091 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-98da4cb7-a000-4e35-b29f-ad5014ef5bc4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:40.298702 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-98da4cb7-a000-4e35-b29f-ad5014ef5bc4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:40.305298 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-98da4cb7-a000-4e35-b29f-ad5014ef5bc4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:40.305749 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-98da4cb7-a000-4e35-b29f-ad5014ef5bc4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:40.306554 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-98da4cb7-a000-4e35-b29f-ad5014ef5bc4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:40.306987 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-98da4cb7-a000-4e35-b29f-ad5014ef5bc4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:40.439182 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-98da4cb7-a000-4e35-b29f-ad5014ef5bc4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:40.447304 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-98da4cb7-a000-4e35-b29f-ad5014ef5bc4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99" status: 200 len: 1497 microversion: 2.1 time: 0.153131 Jul 27 04:32:40.447869 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 460/911] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:40 2022] GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:40.460186 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6b3ef763-41a1-48f8-a277-0a10c0fa2e8d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:40.460804 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6b3ef763-41a1-48f8-a277-0a10c0fa2e8d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:40.467916 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6b3ef763-41a1-48f8-a277-0a10c0fa2e8d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:40.468695 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6b3ef763-41a1-48f8-a277-0a10c0fa2e8d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:40.469356 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6b3ef763-41a1-48f8-a277-0a10c0fa2e8d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:40.469793 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6b3ef763-41a1-48f8-a277-0a10c0fa2e8d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:40.613056 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6b3ef763-41a1-48f8-a277-0a10c0fa2e8d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:40.620871 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6b3ef763-41a1-48f8-a277-0a10c0fa2e8d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1362 microversion: 2.1 time: 0.164993 Jul 27 04:32:40.621878 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 452/912] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:40 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:40.877244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-6192734b-a278-43e9-8ef0-7c1969f567b4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:40.877745 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-6192734b-a278-43e9-8ef0-7c1969f567b4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:40.884470 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6192734b-a278-43e9-8ef0-7c1969f567b4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:40.884914 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6192734b-a278-43e9-8ef0-7c1969f567b4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:40.885683 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6192734b-a278-43e9-8ef0-7c1969f567b4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:40.886175 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-6192734b-a278-43e9-8ef0-7c1969f567b4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:40.910559 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-6192734b-a278-43e9-8ef0-7c1969f567b4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Going to try to terminate instance {{(pid=117740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:32:40.978709 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:40.984451 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-6192734b-a278-43e9-8ef0-7c1969f567b4 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99" status: 204 len: 0 microversion: 2.1 time: 0.110830 Jul 27 04:32:40.985082 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 461/913] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:32:40 2022] DELETE /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:32:40.993758 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-339db191-954f-4864-a38e-6a94126467ab tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:40.994385 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-339db191-954f-4864-a38e-6a94126467ab tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:41.000290 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-339db191-954f-4864-a38e-6a94126467ab tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:41.000727 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-339db191-954f-4864-a38e-6a94126467ab tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:41.001482 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-339db191-954f-4864-a38e-6a94126467ab tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:41.002079 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-339db191-954f-4864-a38e-6a94126467ab tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:41.010550 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-fd160b61-cc1a-4acf-850c-43bebb728f65 req-5e48ee11-a136-4ca3-9023-4044175ab614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0d21bc-cb26-4062-92ef-e03a680c90c0", "name": "network-vif-plugged", "status": "completed", "tag": "5349185d-2368-47e0-8150-20b7da691812"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:41.021079 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-fd160b61-cc1a-4acf-850c-43bebb728f65 req-5e48ee11-a136-4ca3-9023-4044175ab614 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:41.021527 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-fd160b61-cc1a-4acf-850c-43bebb728f65 req-5e48ee11-a136-4ca3-9023-4044175ab614 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:41.033823 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-fd160b61-cc1a-4acf-850c-43bebb728f65 req-5e48ee11-a136-4ca3-9023-4044175ab614 service nova] Creating event network-vif-plugged:5349185d-2368-47e0-8150-20b7da691812 for instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 on hv-cinder-85098 Jul 27 04:32:41.038897 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-fd160b61-cc1a-4acf-850c-43bebb728f65 req-5e48ee11-a136-4ca3-9023-4044175ab614 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032343 Jul 27 04:32:41.039492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 462/914] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:32:41.138034 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-339db191-954f-4864-a38e-6a94126467ab tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:41.146504 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-339db191-954f-4864-a38e-6a94126467ab tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99" status: 200 len: 1503 microversion: 2.1 time: 0.156353 Jul 27 04:32:41.147073 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 453/915] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:40 2022] GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:41.643599 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0637237b-beb8-49b6-a024-52b7d37442d3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:41.644300 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0637237b-beb8-49b6-a024-52b7d37442d3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:41.651234 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0637237b-beb8-49b6-a024-52b7d37442d3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:41.651690 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0637237b-beb8-49b6-a024-52b7d37442d3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:41.652459 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0637237b-beb8-49b6-a024-52b7d37442d3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:41.653089 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0637237b-beb8-49b6-a024-52b7d37442d3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:41.783379 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0637237b-beb8-49b6-a024-52b7d37442d3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:41.791319 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0637237b-beb8-49b6-a024-52b7d37442d3 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1362 microversion: 2.1 time: 0.152420 Jul 27 04:32:41.791883 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 463/916] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:41 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:42.167876 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-1fddfd01-d91b-4c13-90da-5a0f13d4ebff tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:42.168492 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-1fddfd01-d91b-4c13-90da-5a0f13d4ebff tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:42.170957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:42.176740 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1fddfd01-d91b-4c13-90da-5a0f13d4ebff tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:42.177191 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1fddfd01-d91b-4c13-90da-5a0f13d4ebff tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:42.177989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1fddfd01-d91b-4c13-90da-5a0f13d4ebff tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:42.178484 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1fddfd01-d91b-4c13-90da-5a0f13d4ebff tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:42.338460 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-1fddfd01-d91b-4c13-90da-5a0f13d4ebff tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:42.345799 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-1fddfd01-d91b-4c13-90da-5a0f13d4ebff tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99" status: 200 len: 1503 microversion: 2.1 time: 0.181822 Jul 27 04:32:42.346372 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 454/917] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:42 2022] GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:42.812864 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c94d6fb5-92ba-45f1-8434-4d39f7afaa34 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:42.813729 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c94d6fb5-92ba-45f1-8434-4d39f7afaa34 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:42.815818 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:42.816675 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=10 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:42.824032 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c94d6fb5-92ba-45f1-8434-4d39f7afaa34 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:42.824410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c94d6fb5-92ba-45f1-8434-4d39f7afaa34 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:42.825177 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c94d6fb5-92ba-45f1-8434-4d39f7afaa34 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:42.825620 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c94d6fb5-92ba-45f1-8434-4d39f7afaa34 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:42.944266 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-4e605c88-03cb-49e6-afb7-228c13a0720f req-8b6a906e-c0dd-4a1f-a05e-d4c6e31c0a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a68669a-49bb-4a22-bd5b-9801e50a6d99", "name": "network-vif-deleted", "tag": "0a92b684-aab1-4972-86be-c1a6a1b54eb0"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:42.949642 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=10 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:42.955988 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-4e605c88-03cb-49e6-afb7-228c13a0720f req-8b6a906e-c0dd-4a1f-a05e-d4c6e31c0a0c service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:42.956429 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-4e605c88-03cb-49e6-afb7-228c13a0720f req-8b6a906e-c0dd-4a1f-a05e-d4c6e31c0a0c service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:42.969697 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-4e605c88-03cb-49e6-afb7-228c13a0720f req-8b6a906e-c0dd-4a1f-a05e-d4c6e31c0a0c service nova] Creating event network-vif-deleted:0a92b684-aab1-4972-86be-c1a6a1b54eb0 for instance 9a68669a-49bb-4a22-bd5b-9801e50a6d99 on hv-cinder-85098 Jul 27 04:32:42.976182 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-4e605c88-03cb-49e6-afb7-228c13a0720f req-8b6a906e-c0dd-4a1f-a05e-d4c6e31c0a0c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035425 Jul 27 04:32:42.977082 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 455/918] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:32:43.025451 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-c94d6fb5-92ba-45f1-8434-4d39f7afaa34 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:43.033283 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c94d6fb5-92ba-45f1-8434-4d39f7afaa34 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1362 microversion: 2.1 time: 0.224335 Jul 27 04:32:43.033863 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 464/919] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:42 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:43.368633 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-fa19a830-d7c1-43f4-8017-5c246ba2101c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:43.369243 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-fa19a830-d7c1-43f4-8017-5c246ba2101c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:43.375968 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fa19a830-d7c1-43f4-8017-5c246ba2101c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:43.376566 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fa19a830-d7c1-43f4-8017-5c246ba2101c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:43.377252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fa19a830-d7c1-43f4-8017-5c246ba2101c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:43.379022 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fa19a830-d7c1-43f4-8017-5c246ba2101c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:43.412083 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fa19a830-d7c1-43f4-8017-5c246ba2101c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:43.412534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-fa19a830-d7c1-43f4-8017-5c246ba2101c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:43.412986 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.objects.instance [None req-fa19a830-d7c1-43f4-8017-5c246ba2101c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lazy-loading 'fault' on Instance uuid 9a68669a-49bb-4a22-bd5b-9801e50a6d99 {{(pid=117739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:32:43.454468 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-fa19a830-d7c1-43f4-8017-5c246ba2101c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e9a87bc39f4456ab90586e02d0785d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8c051d2c14448ab9a73672f3f00a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:43.462169 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-fa19a830-d7c1-43f4-8017-5c246ba2101c tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99" status: 200 len: 1304 microversion: 2.1 time: 0.099078 Jul 27 04:32:43.462739 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 456/920] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:43 2022] GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:44.055650 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-dc23497a-e7a5-4622-8c72-ebb6703d7b35 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:44.056259 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-dc23497a-e7a5-4622-8c72-ebb6703d7b35 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:44.062670 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dc23497a-e7a5-4622-8c72-ebb6703d7b35 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:44.063114 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dc23497a-e7a5-4622-8c72-ebb6703d7b35 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:44.063866 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dc23497a-e7a5-4622-8c72-ebb6703d7b35 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:44.064295 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-dc23497a-e7a5-4622-8c72-ebb6703d7b35 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:44.191116 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-dc23497a-e7a5-4622-8c72-ebb6703d7b35 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:32:44.198973 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-dc23497a-e7a5-4622-8c72-ebb6703d7b35 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1546 microversion: 2.1 time: 0.147526 Jul 27 04:32:44.199533 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 465/921] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:44 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1546 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:32:44.219473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-4daee7a1-f202-47d5-bfa5-582844acdc03 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:44.219966 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-4daee7a1-f202-47d5-bfa5-582844acdc03 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:44.226793 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4daee7a1-f202-47d5-bfa5-582844acdc03 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:44.227244 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4daee7a1-f202-47d5-bfa5-582844acdc03 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:44.228009 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4daee7a1-f202-47d5-bfa5-582844acdc03 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:44.228445 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-4daee7a1-f202-47d5-bfa5-582844acdc03 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:44.302991 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-4daee7a1-f202-47d5-bfa5-582844acdc03 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087269 Jul 27 04:32:44.303591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 457/922] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Jul 27 04:32:44 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:32:44.483433 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1f324f00-b85e-4602-b54b-bf4fc9c14716 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:32:44.484041 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-1f324f00-b85e-4602-b54b-bf4fc9c14716 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] [instance: 9a68669a-49bb-4a22-bd5b-9801e50a6d99] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:32:44.490399 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1f324f00-b85e-4602-b54b-bf4fc9c14716 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:44.490838 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1f324f00-b85e-4602-b54b-bf4fc9c14716 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:44.491593 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1f324f00-b85e-4602-b54b-bf4fc9c14716 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:44.492030 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1f324f00-b85e-4602-b54b-bf4fc9c14716 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:44.506440 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-1f324f00-b85e-4602-b54b-bf4fc9c14716 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] HTTP exception thrown: Instance 9a68669a-49bb-4a22-bd5b-9801e50a6d99 could not be found. Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1f324f00-b85e-4602-b54b-bf4fc9c14716 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Request method failure captured: Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 HTTP/1.1 Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L_P8Tw4-AepRdlDf1n4M7TxwlU6EpweZl28z4K7Js3TRSqM-TK87U-l7RIc3Ju04iMGzhA6XDLOAzJoJ7jxuPEYOgc9CWF5GmrZXiALiZlZq44tLHHlV4NVmSIzys75KHwrHReAvY97on5m8BiFIOAF9hbY4S8CzVIMnVwD2iHEaUs Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 37f8c051d2c14448ab9a73672f3f00a9 Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-VolumesActionsTest-1302665209 Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:32:44.508066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:32:44.509454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/37f8c051d2c14448ab9a73672f3f00a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/37f8c051d2c14448ab9a73672f3f00a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/37f8c051d2c14448ab9a73672f3f00a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_37f8c051d2c14448ab9a73672f3f00a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:32:44.509454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-VolumesActionsTest-1302665209 Jul 27 04:32:44.509454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 37f8c051d2c14448ab9a73672f3f00a9 Jul 27 04:32:44.509454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-VolumesActionsTest-1302665209 Jul 27 04:32:44.509454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-VolumesActionsTest-1302665209-project Jul 27 04:32:44.509454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:32:44.509454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:32:44.509454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 69e9a87bc39f4456ab90586e02d0785d Jul 27 04:32:44.509454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-VolumesActionsTest-1302665209-project Jul 27 04:32:44.509454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:32:44.509454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 9a68669a-49bb-4a22-bd5b-9801e50a6d99 could not be found. Jul 27 04:32:44.509454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '9a68669a-49bb-4a22-bd5b-9801e50a6d99'} Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a68669a-49bb-4a22-bd5b-9801e50a6d99 could not be found. Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:32:44.510611 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a68669a-49bb-4a22-bd5b-9801e50a6d99 could not be found. Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a68669a-49bb-4a22-bd5b-9801e50a6d99 could not be found. Jul 27 04:32:44.512154 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:32:44.513473 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1f324f00-b85e-4602-b54b-bf4fc9c14716 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] Returning 404 to user: Instance 9a68669a-49bb-4a22-bd5b-9801e50a6d99 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:32:44.513473 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-1f324f00-b85e-4602-b54b-bf4fc9c14716 tempest-VolumesActionsTest-1302665209 tempest-VolumesActionsTest-1302665209-project] 10.222.0.46 "GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99" status: 404 len: 111 microversion: 2.1 time: 0.029910 Jul 27 04:32:44.513473 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 466/923] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:32:44 2022] GET /compute/v2.1/servers/9a68669a-49bb-4a22-bd5b-9801e50a6d99 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:32:45.592194 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-3459aa2d-0d60-45cf-94fe-a32c95b48dff req-6d4889de-6803-4b04-aab1-8bef95c196e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0d21bc-cb26-4062-92ef-e03a680c90c0", "tag": "5349185d-2368-47e0-8150-20b7da691812"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:32:45.601674 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-3459aa2d-0d60-45cf-94fe-a32c95b48dff req-6d4889de-6803-4b04-aab1-8bef95c196e8 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:32:45.602157 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-3459aa2d-0d60-45cf-94fe-a32c95b48dff req-6d4889de-6803-4b04-aab1-8bef95c196e8 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:32:45.612954 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-3459aa2d-0d60-45cf-94fe-a32c95b48dff req-6d4889de-6803-4b04-aab1-8bef95c196e8 service nova] Creating event network-changed:5349185d-2368-47e0-8150-20b7da691812 for instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 on hv-cinder-85098 Jul 27 04:32:45.617957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-3459aa2d-0d60-45cf-94fe-a32c95b48dff req-6d4889de-6803-4b04-aab1-8bef95c196e8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084714 Jul 27 04:32:45.618637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 458/924] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:33:19.562180 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-483667114", "imageRef": "d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6", "flavorRef": "452"}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:33:19.569190 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=10 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:33:19.570063 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:33:19.617503 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.network.neutron [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] validate_networks() for None {{(pid=117740) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:33:19.884025 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Flavor limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:33:19.884451 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Image limits 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:33:19.884928 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Flavor pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:33:19.886032 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Image pref 0:0:0 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:33:19.886458 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.virt.hardware [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:33:19.898124 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:19.898575 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:19.899380 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:19.899818 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:19.917550 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Getting quotas for project 4f9d86602f8f4430a42e9d5e829c0cef. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:33:19.921537 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Getting quotas for user 6f7abba95ba04197b6af7e5e20bbc824 and project 4f9d86602f8f4430a42e9d5e829c0cef. Resources: {'instances', 'ram', 'cores'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:33:19.932328 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Going to run 1 instances... {{(pid=117740) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:33:19.934553 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1f0aacf-c3a1-4363-82cf-3511ddfd2dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:33:19.979562 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f106f442-4a18-43c7-a87b-00e25b85c5fb tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.420730 Jul 27 04:33:19.980355 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 467/925] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:33:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:33:19.989079 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:33:19.989922 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=56 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:33:19.995675 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-931777f9-c845-4718-b118-a137d93750b1 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:19.996473 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-931777f9-c845-4718-b118-a137d93750b1 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:20.053402 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-931777f9-c845-4718-b118-a137d93750b1 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7abba95ba04197b6af7e5e20bbc824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9d86602f8f4430a42e9d5e829c0cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:20.060081 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-931777f9-c845-4718-b118-a137d93750b1 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 200 len: 1214 microversion: 2.1 time: 0.072796 Jul 27 04:33:20.060638 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 459/926] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:19 2022] GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:33:21.082100 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-fb0e893c-0747-4cff-8466-b1d2608ddacd tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:21.082704 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-fb0e893c-0747-4cff-8466-b1d2608ddacd tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:21.089382 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fb0e893c-0747-4cff-8466-b1d2608ddacd tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:21.089926 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fb0e893c-0747-4cff-8466-b1d2608ddacd tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:21.090717 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fb0e893c-0747-4cff-8466-b1d2608ddacd tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:21.091151 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fb0e893c-0747-4cff-8466-b1d2608ddacd tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:21.158963 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-fb0e893c-0747-4cff-8466-b1d2608ddacd tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7abba95ba04197b6af7e5e20bbc824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9d86602f8f4430a42e9d5e829c0cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:21.167127 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-fb0e893c-0747-4cff-8466-b1d2608ddacd tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 200 len: 1272 microversion: 2.1 time: 0.089297 Jul 27 04:33:21.167764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 468/927] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:21 2022] GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:33:21.687568 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-32e6d5f0-0f78-4558-8faf-087bb96997c9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:21.688725 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-32e6d5f0-0f78-4558-8faf-087bb96997c9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:21.695604 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-32e6d5f0-0f78-4558-8faf-087bb96997c9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:21.696030 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-32e6d5f0-0f78-4558-8faf-087bb96997c9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:21.696795 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-32e6d5f0-0f78-4558-8faf-087bb96997c9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:21.697227 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-32e6d5f0-0f78-4558-8faf-087bb96997c9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:21.724047 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-32e6d5f0-0f78-4558-8faf-087bb96997c9 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/ips" status: 200 len: 144 microversion: 2.1 time: 0.041489 Jul 27 04:33:21.724823 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 460/928] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Jul 27 04:33:21 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:33:22.189218 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9843b5da-8ba8-4291-87a0-dbde72217a70 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:22.189955 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-9843b5da-8ba8-4291-87a0-dbde72217a70 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:22.196695 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9843b5da-8ba8-4291-87a0-dbde72217a70 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:22.197139 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9843b5da-8ba8-4291-87a0-dbde72217a70 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:22.198283 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9843b5da-8ba8-4291-87a0-dbde72217a70 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:22.198720 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9843b5da-8ba8-4291-87a0-dbde72217a70 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:22.409807 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-9843b5da-8ba8-4291-87a0-dbde72217a70 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7abba95ba04197b6af7e5e20bbc824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9d86602f8f4430a42e9d5e829c0cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:22.418277 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-9843b5da-8ba8-4291-87a0-dbde72217a70 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 200 len: 1314 microversion: 2.1 time: 0.233644 Jul 27 04:33:22.418855 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 469/929] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:22 2022] GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:33:22.656211 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-99616456-0a4c-4b0b-93b9-a69ebf57c0ff req-32c0ac83-96a4-47ab-ab7f-639a3bbcfd6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5977e60-84b1-4a35-b1d9-88c678fb5f01", "tag": "00e38837-d291-4dab-b869-b3fc23712ee6"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:33:22.670901 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-99616456-0a4c-4b0b-93b9-a69ebf57c0ff req-32c0ac83-96a4-47ab-ab7f-639a3bbcfd6e service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:22.671571 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-99616456-0a4c-4b0b-93b9-a69ebf57c0ff req-32c0ac83-96a4-47ab-ab7f-639a3bbcfd6e service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:22.685651 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-99616456-0a4c-4b0b-93b9-a69ebf57c0ff req-32c0ac83-96a4-47ab-ab7f-639a3bbcfd6e service nova] Creating event network-changed:00e38837-d291-4dab-b869-b3fc23712ee6 for instance f5977e60-84b1-4a35-b1d9-88c678fb5f01 on hv-cinder-85098 Jul 27 04:33:22.690936 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-99616456-0a4c-4b0b-93b9-a69ebf57c0ff req-32c0ac83-96a4-47ab-ab7f-639a3bbcfd6e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038386 Jul 27 04:33:22.692040 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 461/930] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:33:23.091777 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-63681b7c-9d56-4acd-9e7d-6351f6984125 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61342c0b-0e1e-49bc-8157-c5d297b90c37"}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:33:23.094195 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-63681b7c-9d56-4acd-9e7d-6351f6984125 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:23.100788 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-63681b7c-9d56-4acd-9e7d-6351f6984125 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:23.101273 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-63681b7c-9d56-4acd-9e7d-6351f6984125 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:23.102144 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-63681b7c-9d56-4acd-9e7d-6351f6984125 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:23.102589 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-63681b7c-9d56-4acd-9e7d-6351f6984125 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:23.442412 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-dbab91b1-0977-44bc-a748-21971d335e8a tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:23.443023 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-dbab91b1-0977-44bc-a748-21971d335e8a tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:23.450757 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-dbab91b1-0977-44bc-a748-21971d335e8a tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:23.451200 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-dbab91b1-0977-44bc-a748-21971d335e8a tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:23.451957 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-dbab91b1-0977-44bc-a748-21971d335e8a tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:23.452456 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-dbab91b1-0977-44bc-a748-21971d335e8a tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:23.582896 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-dbab91b1-0977-44bc-a748-21971d335e8a tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7abba95ba04197b6af7e5e20bbc824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9d86602f8f4430a42e9d5e829c0cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:23.590204 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-dbab91b1-0977-44bc-a748-21971d335e8a tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 200 len: 1314 microversion: 2.1 time: 0.151997 Jul 27 04:33:23.590757 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 462/931] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:23 2022] GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:33:23.958525 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-63681b7c-9d56-4acd-9e7d-6351f6984125 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "POST /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871655 Jul 27 04:33:23.959318 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 470/932] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:33:23 2022] POST /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments => generated 194 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:33:24.611146 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b9e63f69-148a-47d7-8604-11ba45b12293 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:24.611680 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-b9e63f69-148a-47d7-8604-11ba45b12293 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:24.618207 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b9e63f69-148a-47d7-8604-11ba45b12293 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:24.618654 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b9e63f69-148a-47d7-8604-11ba45b12293 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:24.619409 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b9e63f69-148a-47d7-8604-11ba45b12293 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:24.620443 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-b9e63f69-148a-47d7-8604-11ba45b12293 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:24.753410 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-b9e63f69-148a-47d7-8604-11ba45b12293 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7abba95ba04197b6af7e5e20bbc824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9d86602f8f4430a42e9d5e829c0cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:24.761031 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-b9e63f69-148a-47d7-8604-11ba45b12293 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 200 len: 1314 microversion: 2.1 time: 0.153763 Jul 27 04:33:24.761584 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 463/933] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:24 2022] GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:33:25.783205 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-53afc583-d596-4e71-924e-fb57af08a5f7 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:25.783910 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-53afc583-d596-4e71-924e-fb57af08a5f7 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:25.790086 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-53afc583-d596-4e71-924e-fb57af08a5f7 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:25.790570 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-53afc583-d596-4e71-924e-fb57af08a5f7 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:25.791318 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-53afc583-d596-4e71-924e-fb57af08a5f7 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:25.791751 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-53afc583-d596-4e71-924e-fb57af08a5f7 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:25.920896 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-53afc583-d596-4e71-924e-fb57af08a5f7 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7abba95ba04197b6af7e5e20bbc824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9d86602f8f4430a42e9d5e829c0cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:25.928183 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-53afc583-d596-4e71-924e-fb57af08a5f7 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 200 len: 1314 microversion: 2.1 time: 0.149703 Jul 27 04:33:25.928743 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 471/934] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:25 2022] GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:33:26.949205 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7a55d5de-7feb-4531-a1d8-03d666be1203 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:26.949834 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-7a55d5de-7feb-4531-a1d8-03d666be1203 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:26.957581 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7a55d5de-7feb-4531-a1d8-03d666be1203 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:26.958859 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7a55d5de-7feb-4531-a1d8-03d666be1203 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:26.959643 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7a55d5de-7feb-4531-a1d8-03d666be1203 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:26.960081 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7a55d5de-7feb-4531-a1d8-03d666be1203 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:26.984803 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-976df0ea-9c30-4a00-a28d-6edf1f6dc769 req-4f4a1da7-d5f2-4a1b-bb95-b2e8d351cb75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5977e60-84b1-4a35-b1d9-88c678fb5f01", "name": "network-vif-plugged", "status": "completed", "tag": "00e38837-d291-4dab-b869-b3fc23712ee6"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:33:26.998410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-976df0ea-9c30-4a00-a28d-6edf1f6dc769 req-4f4a1da7-d5f2-4a1b-bb95-b2e8d351cb75 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:26.999615 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-976df0ea-9c30-4a00-a28d-6edf1f6dc769 req-4f4a1da7-d5f2-4a1b-bb95-b2e8d351cb75 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:27.012131 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-976df0ea-9c30-4a00-a28d-6edf1f6dc769 req-4f4a1da7-d5f2-4a1b-bb95-b2e8d351cb75 service nova] Creating event network-vif-plugged:00e38837-d291-4dab-b869-b3fc23712ee6 for instance f5977e60-84b1-4a35-b1d9-88c678fb5f01 on hv-cinder-85098 Jul 27 04:33:27.017371 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-976df0ea-9c30-4a00-a28d-6edf1f6dc769 req-4f4a1da7-d5f2-4a1b-bb95-b2e8d351cb75 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036647 Jul 27 04:33:27.018198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 472/935] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:33:27.101348 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-7a55d5de-7feb-4531-a1d8-03d666be1203 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7abba95ba04197b6af7e5e20bbc824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9d86602f8f4430a42e9d5e829c0cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:27.109222 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-7a55d5de-7feb-4531-a1d8-03d666be1203 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 200 len: 1314 microversion: 2.1 time: 0.164406 Jul 27 04:33:27.109790 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 464/936] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:26 2022] GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:33:28.131647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-3b76be69-834b-468a-b74d-581b38d527af tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:28.132345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-3b76be69-834b-468a-b74d-581b38d527af tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:28.139604 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3b76be69-834b-468a-b74d-581b38d527af tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:28.140049 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3b76be69-834b-468a-b74d-581b38d527af tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:28.140803 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3b76be69-834b-468a-b74d-581b38d527af tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:28.141234 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-3b76be69-834b-468a-b74d-581b38d527af tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:28.280565 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-3b76be69-834b-468a-b74d-581b38d527af tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7abba95ba04197b6af7e5e20bbc824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9d86602f8f4430a42e9d5e829c0cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:28.288043 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-3b76be69-834b-468a-b74d-581b38d527af tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 200 len: 1314 microversion: 2.1 time: 0.160470 Jul 27 04:33:28.288609 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 473/937] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:28 2022] GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:33:29.309020 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-ff43a25e-db92-4df0-9018-2d23a7ec77d3 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:29.309630 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-ff43a25e-db92-4df0-9018-2d23a7ec77d3 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:29.316171 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ff43a25e-db92-4df0-9018-2d23a7ec77d3 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:29.316611 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ff43a25e-db92-4df0-9018-2d23a7ec77d3 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:29.317366 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ff43a25e-db92-4df0-9018-2d23a7ec77d3 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:29.317829 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-ff43a25e-db92-4df0-9018-2d23a7ec77d3 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:29.446845 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-ff43a25e-db92-4df0-9018-2d23a7ec77d3 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7abba95ba04197b6af7e5e20bbc824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9d86602f8f4430a42e9d5e829c0cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:29.455090 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-ff43a25e-db92-4df0-9018-2d23a7ec77d3 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 200 len: 1463 microversion: 2.1 time: 0.150487 Jul 27 04:33:29.455648 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 465/938] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:29 2022] GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 1463 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:33:29.502482 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7cac826c-73a3-4d8a-9968-8381a66abf5e tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:29.503006 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-7cac826c-73a3-4d8a-9968-8381a66abf5e tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:29.509424 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7cac826c-73a3-4d8a-9968-8381a66abf5e tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:29.509814 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7cac826c-73a3-4d8a-9968-8381a66abf5e tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:29.510692 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7cac826c-73a3-4d8a-9968-8381a66abf5e tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:29.511153 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7cac826c-73a3-4d8a-9968-8381a66abf5e tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:29.537499 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-7cac826c-73a3-4d8a-9968-8381a66abf5e tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Going to try to terminate instance {{(pid=117740) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:33:29.611114 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-7cac826c-73a3-4d8a-9968-8381a66abf5e tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 204 len: 0 microversion: 2.1 time: 0.112177 Jul 27 04:33:29.611686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 474/939] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:33:29 2022] DELETE /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:33:29.619743 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9d2405e7-bf0a-46c3-b059-315aa42a6a77 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:29.620475 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9d2405e7-bf0a-46c3-b059-315aa42a6a77 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:29.626478 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9d2405e7-bf0a-46c3-b059-315aa42a6a77 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:29.626935 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9d2405e7-bf0a-46c3-b059-315aa42a6a77 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:29.627663 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9d2405e7-bf0a-46c3-b059-315aa42a6a77 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:29.628090 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9d2405e7-bf0a-46c3-b059-315aa42a6a77 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:29.759108 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9d2405e7-bf0a-46c3-b059-315aa42a6a77 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7abba95ba04197b6af7e5e20bbc824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9d86602f8f4430a42e9d5e829c0cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:29.767803 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9d2405e7-bf0a-46c3-b059-315aa42a6a77 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 200 len: 1469 microversion: 2.1 time: 0.151754 Jul 27 04:33:29.768309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 466/940] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:29 2022] GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:33:30.790480 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-853255a9-d122-46ce-b4e1-c292a3c24888 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:30.791173 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-853255a9-d122-46ce-b4e1-c292a3c24888 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:30.793151 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:33:30.793796 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=6 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:33:30.800136 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-853255a9-d122-46ce-b4e1-c292a3c24888 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:30.800575 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-853255a9-d122-46ce-b4e1-c292a3c24888 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:30.801349 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-853255a9-d122-46ce-b4e1-c292a3c24888 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:30.801760 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-853255a9-d122-46ce-b4e1-c292a3c24888 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:30.933828 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-853255a9-d122-46ce-b4e1-c292a3c24888 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7abba95ba04197b6af7e5e20bbc824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9d86602f8f4430a42e9d5e829c0cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:30.941233 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-853255a9-d122-46ce-b4e1-c292a3c24888 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 200 len: 1469 microversion: 2.1 time: 0.154949 Jul 27 04:33:30.941787 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 475/941] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:30 2022] GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:33:31.488563 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-71c7cd11-81a2-4af8-9a2c-137103b369d6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:31.490834 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-71c7cd11-81a2-4af8-9a2c-137103b369d6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:31.493117 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:33:31.499220 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-71c7cd11-81a2-4af8-9a2c-137103b369d6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:31.499652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-71c7cd11-81a2-4af8-9a2c-137103b369d6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:31.500505 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-71c7cd11-81a2-4af8-9a2c-137103b369d6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:31.500972 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-71c7cd11-81a2-4af8-9a2c-137103b369d6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:31.530678 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-71c7cd11-81a2-4af8-9a2c-137103b369d6 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046018 Jul 27 04:33:31.531425 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 467/942] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:33:31 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:33:31.541852 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-fedf4d4f-834c-4fa5-99dc-fa460e8b5e9c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:31.542957 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-fedf4d4f-834c-4fa5-99dc-fa460e8b5e9c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:31.548918 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fedf4d4f-834c-4fa5-99dc-fa460e8b5e9c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:31.549427 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fedf4d4f-834c-4fa5-99dc-fa460e8b5e9c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:31.550235 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fedf4d4f-834c-4fa5-99dc-fa460e8b5e9c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:31.550848 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fedf4d4f-834c-4fa5-99dc-fa460e8b5e9c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:31.587217 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-fedf4d4f-834c-4fa5-99dc-fa460e8b5e9c tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments/61342c0b-0e1e-49bc-8157-c5d297b90c37" status: 200 len: 194 microversion: 2.1 time: 0.049188 Jul 27 04:33:31.593113 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 476/943] 10.222.0.46 () {58 vars in 1413 bytes} [Wed Jul 27 04:33:31 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments/61342c0b-0e1e-49bc-8157-c5d297b90c37 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:33:31.660114 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-fb1073e3-e0ef-4afc-9210-fbf06e90a54b req-50c991e6-414b-4f0f-ae03-d60f291d72bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5977e60-84b1-4a35-b1d9-88c678fb5f01", "name": "network-vif-deleted", "tag": "00e38837-d291-4dab-b869-b3fc23712ee6"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:33:31.671964 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-fb1073e3-e0ef-4afc-9210-fbf06e90a54b req-50c991e6-414b-4f0f-ae03-d60f291d72bd service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:31.672677 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-fb1073e3-e0ef-4afc-9210-fbf06e90a54b req-50c991e6-414b-4f0f-ae03-d60f291d72bd service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:31.687123 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-fb1073e3-e0ef-4afc-9210-fbf06e90a54b req-50c991e6-414b-4f0f-ae03-d60f291d72bd service nova] Creating event network-vif-deleted:00e38837-d291-4dab-b869-b3fc23712ee6 for instance f5977e60-84b1-4a35-b1d9-88c678fb5f01 on hv-cinder-85098 Jul 27 04:33:31.693002 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-fb1073e3-e0ef-4afc-9210-fbf06e90a54b req-50c991e6-414b-4f0f-ae03-d60f291d72bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036528 Jul 27 04:33:31.694157 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 468/944] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:33:31.963555 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-9bbb7aa4-592b-47f3-826d-d121d5c161a2 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:31.964941 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-9bbb7aa4-592b-47f3-826d-d121d5c161a2 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:31.972130 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9bbb7aa4-592b-47f3-826d-d121d5c161a2 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:31.972661 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9bbb7aa4-592b-47f3-826d-d121d5c161a2 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:31.973430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9bbb7aa4-592b-47f3-826d-d121d5c161a2 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:31.974077 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9bbb7aa4-592b-47f3-826d-d121d5c161a2 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:32.004637 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9bbb7aa4-592b-47f3-826d-d121d5c161a2 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:32.005081 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-9bbb7aa4-592b-47f3-826d-d121d5c161a2 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:32.005528 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-9bbb7aa4-592b-47f3-826d-d121d5c161a2 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lazy-loading 'fault' on Instance uuid f5977e60-84b1-4a35-b1d9-88c678fb5f01 {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:33:32.047822 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-9bbb7aa4-592b-47f3-826d-d121d5c161a2 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7abba95ba04197b6af7e5e20bbc824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9d86602f8f4430a42e9d5e829c0cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:32.055328 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-9bbb7aa4-592b-47f3-826d-d121d5c161a2 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 200 len: 1304 microversion: 2.1 time: 0.095603 Jul 27 04:33:32.055967 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 477/945] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:31 2022] GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:33:32.980586 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-aba49f11-01f2-4e06-98cf-95186196fb91 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7683c869-917f-462e-be51-be9ad7f53fe3"}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:33:32.983177 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-aba49f11-01f2-4e06-98cf-95186196fb91 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:32.989312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-aba49f11-01f2-4e06-98cf-95186196fb91 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:32.989763 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-aba49f11-01f2-4e06-98cf-95186196fb91 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:32.990561 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-aba49f11-01f2-4e06-98cf-95186196fb91 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:32.991001 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-aba49f11-01f2-4e06-98cf-95186196fb91 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:33.077396 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-afe4e639-3207-4f70-b3bb-f17a3b56cf48 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:33.078043 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-afe4e639-3207-4f70-b3bb-f17a3b56cf48 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] [instance: f5977e60-84b1-4a35-b1d9-88c678fb5f01] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:33.084494 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-afe4e639-3207-4f70-b3bb-f17a3b56cf48 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:33.084979 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-afe4e639-3207-4f70-b3bb-f17a3b56cf48 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:33.085754 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-afe4e639-3207-4f70-b3bb-f17a3b56cf48 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:33.086222 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-afe4e639-3207-4f70-b3bb-f17a3b56cf48 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:33.099956 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-afe4e639-3207-4f70-b3bb-f17a3b56cf48 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] HTTP exception thrown: Instance f5977e60-84b1-4a35-b1d9-88c678fb5f01 could not be found. Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-afe4e639-3207-4f70-b3bb-f17a3b56cf48 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Request method failure captured: Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 HTTP/1.1 Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4MAOJlt9FTYgFiEGcvVOpu9dkFC2VLePtOxNDHe6WtXK3Z1i_qWSUXJC22TnIaoQi5pl3IN9mcdMlzMgTNpPzn48o4hkUk-KdvU65ZgMq4AkDnx8mDL1ul_qCiyy7x-hDAdkDcInkK_2Ly2uxkgLQgYNsroVxe0tpvOX8lClsQsRXm8 Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 4f9d86602f8f4430a42e9d5e829c0cef Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-VolumesNegativeTest-316235240 Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:33:33.101633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:33:33.103534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4f9d86602f8f4430a42e9d5e829c0cef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f9d86602f8f4430a42e9d5e829c0cef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f9d86602f8f4430a42e9d5e829c0cef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4f9d86602f8f4430a42e9d5e829c0cef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:33:33.103534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-VolumesNegativeTest-316235240 Jul 27 04:33:33.103534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 4f9d86602f8f4430a42e9d5e829c0cef Jul 27 04:33:33.103534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-VolumesNegativeTest-316235240 Jul 27 04:33:33.103534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-VolumesNegativeTest-316235240-project Jul 27 04:33:33.103534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:33:33.103534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:33:33.103534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 6f7abba95ba04197b6af7e5e20bbc824 Jul 27 04:33:33.103534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-VolumesNegativeTest-316235240-project Jul 27 04:33:33.103534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:33:33.103534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance f5977e60-84b1-4a35-b1d9-88c678fb5f01 could not be found. Jul 27 04:33:33.103534 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': 'f5977e60-84b1-4a35-b1d9-88c678fb5f01'} Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5977e60-84b1-4a35-b1d9-88c678fb5f01 could not be found. Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:33:33.104521 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5977e60-84b1-4a35-b1d9-88c678fb5f01 could not be found. Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5977e60-84b1-4a35-b1d9-88c678fb5f01 could not be found. Jul 27 04:33:33.106647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:33.108100 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-afe4e639-3207-4f70-b3bb-f17a3b56cf48 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] Returning 404 to user: Instance f5977e60-84b1-4a35-b1d9-88c678fb5f01 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:33:33.108100 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-afe4e639-3207-4f70-b3bb-f17a3b56cf48 tempest-VolumesNegativeTest-316235240 tempest-VolumesNegativeTest-316235240-project] 10.222.0.46 "GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01" status: 404 len: 111 microversion: 2.1 time: 0.030524 Jul 27 04:33:33.108100 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 478/946] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:33 2022] GET /compute/v2.1/servers/f5977e60-84b1-4a35-b1d9-88c678fb5f01 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 04:33:33.248739 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-aba49f11-01f2-4e06-98cf-95186196fb91 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "POST /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272751 Jul 27 04:33:33.249125 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 469/947] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:33:32 2022] POST /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:33:39.726954 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-2b79cf7c-9241-40b7-ac55-6925f14f0654 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:39.729213 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-2b79cf7c-9241-40b7-ac55-6925f14f0654 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:39.735888 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2b79cf7c-9241-40b7-ac55-6925f14f0654 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:39.736345 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2b79cf7c-9241-40b7-ac55-6925f14f0654 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:39.737119 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2b79cf7c-9241-40b7-ac55-6925f14f0654 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:39.737557 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2b79cf7c-9241-40b7-ac55-6925f14f0654 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:39.766793 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-2b79cf7c-9241-40b7-ac55-6925f14f0654 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043794 Jul 27 04:33:39.767340 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 479/948] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:33:39 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:33:39.865417 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0007981c-a065-4568-9cae-cb4995cc884a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:39.866001 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0007981c-a065-4568-9cae-cb4995cc884a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:39.872855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0007981c-a065-4568-9cae-cb4995cc884a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:39.873304 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0007981c-a065-4568-9cae-cb4995cc884a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:39.874094 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0007981c-a065-4568-9cae-cb4995cc884a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:39.874531 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0007981c-a065-4568-9cae-cb4995cc884a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:39.902420 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0007981c-a065-4568-9cae-cb4995cc884a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments/61342c0b-0e1e-49bc-8157-c5d297b90c37" status: 200 len: 194 microversion: 2.1 time: 0.041855 Jul 27 04:33:39.902987 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 470/949] 10.222.0.46 () {58 vars in 1413 bytes} [Wed Jul 27 04:33:39 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments/61342c0b-0e1e-49bc-8157-c5d297b90c37 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:33:39.912933 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-fccfa6d8-6cd1-40fb-be5b-b3b64d867127 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:39.913434 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-fccfa6d8-6cd1-40fb-be5b-b3b64d867127 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:39.919577 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fccfa6d8-6cd1-40fb-be5b-b3b64d867127 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:39.920032 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fccfa6d8-6cd1-40fb-be5b-b3b64d867127 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:39.920806 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fccfa6d8-6cd1-40fb-be5b-b3b64d867127 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:39.921243 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-fccfa6d8-6cd1-40fb-be5b-b3b64d867127 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:40.000399 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-fccfa6d8-6cd1-40fb-be5b-b3b64d867127 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lazy-loading 'services' on Instance uuid 0a0d21bc-cb26-4062-92ef-e03a680c90c0 {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:33:40.073143 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-fccfa6d8-6cd1-40fb-be5b-b3b64d867127 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments/61342c0b-0e1e-49bc-8157-c5d297b90c37" status: 202 len: 0 microversion: 2.1 time: 0.163838 Jul 27 04:33:40.074510 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 480/950] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Jul 27 04:33:39 2022] DELETE /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments/61342c0b-0e1e-49bc-8157-c5d297b90c37 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:33:41.190162 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e8ac2d11-0deb-44bf-9bf8-c0632dffcf5d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:41.190753 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e8ac2d11-0deb-44bf-9bf8-c0632dffcf5d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:41.196994 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e8ac2d11-0deb-44bf-9bf8-c0632dffcf5d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:41.197447 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e8ac2d11-0deb-44bf-9bf8-c0632dffcf5d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:41.198247 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e8ac2d11-0deb-44bf-9bf8-c0632dffcf5d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:41.198690 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e8ac2d11-0deb-44bf-9bf8-c0632dffcf5d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:41.229269 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e8ac2d11-0deb-44bf-9bf8-c0632dffcf5d tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments/7683c869-917f-462e-be51-be9ad7f53fe3" status: 200 len: 194 microversion: 2.1 time: 0.043107 Jul 27 04:33:41.229838 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 471/951] 10.222.0.46 () {58 vars in 1413 bytes} [Wed Jul 27 04:33:41 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments/7683c869-917f-462e-be51-be9ad7f53fe3 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:33:41.241391 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b58d9fcc-3d74-41e8-8aa1-6c30470297cb tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:41.242020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b58d9fcc-3d74-41e8-8aa1-6c30470297cb tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:41.249256 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b58d9fcc-3d74-41e8-8aa1-6c30470297cb tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:41.249697 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b58d9fcc-3d74-41e8-8aa1-6c30470297cb tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:41.250549 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b58d9fcc-3d74-41e8-8aa1-6c30470297cb tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:41.250980 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b58d9fcc-3d74-41e8-8aa1-6c30470297cb tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:41.268074 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:33:41.332153 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-b58d9fcc-3d74-41e8-8aa1-6c30470297cb tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lazy-loading 'services' on Instance uuid 0a0d21bc-cb26-4062-92ef-e03a680c90c0 {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:33:41.401508 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b58d9fcc-3d74-41e8-8aa1-6c30470297cb tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments/7683c869-917f-462e-be51-be9ad7f53fe3" status: 202 len: 0 microversion: 2.1 time: 0.164263 Jul 27 04:33:41.402124 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 481/952] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Jul 27 04:33:41 2022] DELETE /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments/7683c869-917f-462e-be51-be9ad7f53fe3 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:33:42.570597 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7e67f986-7b48-46fd-9365-50f229e1f338 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:42.572807 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-7e67f986-7b48-46fd-9365-50f229e1f338 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:42.581141 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7e67f986-7b48-46fd-9365-50f229e1f338 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:42.581588 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7e67f986-7b48-46fd-9365-50f229e1f338 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:42.582392 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7e67f986-7b48-46fd-9365-50f229e1f338 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:42.582824 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7e67f986-7b48-46fd-9365-50f229e1f338 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:42.612659 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-7e67f986-7b48-46fd-9365-50f229e1f338 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045885 Jul 27 04:33:42.613206 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 472/953] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:33:42 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 04:33:42.728951 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-067951ad-69ff-403f-ab77-473c8ed49b29 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:42.731934 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-067951ad-69ff-403f-ab77-473c8ed49b29 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:42.738094 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-067951ad-69ff-403f-ab77-473c8ed49b29 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:42.738546 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-067951ad-69ff-403f-ab77-473c8ed49b29 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:42.739305 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-067951ad-69ff-403f-ab77-473c8ed49b29 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:42.739743 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-067951ad-69ff-403f-ab77-473c8ed49b29 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:42.768845 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-067951ad-69ff-403f-ab77-473c8ed49b29 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044717 Jul 27 04:33:42.769396 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 482/954] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:33:42 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 04:33:42.830795 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6e306ab1-9312-493f-85fd-cadc567cbe1a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:42.831337 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6e306ab1-9312-493f-85fd-cadc567cbe1a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:42.837209 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6e306ab1-9312-493f-85fd-cadc567cbe1a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:42.837651 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6e306ab1-9312-493f-85fd-cadc567cbe1a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:42.838430 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6e306ab1-9312-493f-85fd-cadc567cbe1a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:42.838855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6e306ab1-9312-493f-85fd-cadc567cbe1a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:42.863456 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6e306ab1-9312-493f-85fd-cadc567cbe1a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Going to try to terminate instance {{(pid=117739) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:33:42.940989 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6e306ab1-9312-493f-85fd-cadc567cbe1a tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 204 len: 0 microversion: 2.1 time: 0.113688 Jul 27 04:33:42.941771 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 473/955] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:33:42 2022] DELETE /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:33:42.950999 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-700117b3-c05b-48db-a5a2-28da9e0507e2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:42.951628 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-700117b3-c05b-48db-a5a2-28da9e0507e2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:42.957579 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-700117b3-c05b-48db-a5a2-28da9e0507e2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:42.958060 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-700117b3-c05b-48db-a5a2-28da9e0507e2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:42.958876 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-700117b3-c05b-48db-a5a2-28da9e0507e2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:42.959262 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-700117b3-c05b-48db-a5a2-28da9e0507e2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:43.086408 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-700117b3-c05b-48db-a5a2-28da9e0507e2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:43.094671 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-700117b3-c05b-48db-a5a2-28da9e0507e2 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1671 microversion: 2.1 time: 0.148779 Jul 27 04:33:43.095234 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 483/956] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:42 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 04:33:44.117309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-42da3512-fe43-401a-bb3d-e8c344bf1d13 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:44.118038 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-42da3512-fe43-401a-bb3d-e8c344bf1d13 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:44.124573 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-42da3512-fe43-401a-bb3d-e8c344bf1d13 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:44.125028 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-42da3512-fe43-401a-bb3d-e8c344bf1d13 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:44.125795 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-42da3512-fe43-401a-bb3d-e8c344bf1d13 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:44.126516 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-42da3512-fe43-401a-bb3d-e8c344bf1d13 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:44.257407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-42da3512-fe43-401a-bb3d-e8c344bf1d13 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:44.265345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-42da3512-fe43-401a-bb3d-e8c344bf1d13 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1671 microversion: 2.1 time: 0.152276 Jul 27 04:33:44.265902 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 474/957] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:44 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:33:45.286530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-2df8ca5c-93bd-4019-a103-12c3e8b4aeb0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:45.287140 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-2df8ca5c-93bd-4019-a103-12c3e8b4aeb0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:45.293511 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2df8ca5c-93bd-4019-a103-12c3e8b4aeb0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:45.294076 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2df8ca5c-93bd-4019-a103-12c3e8b4aeb0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:45.294889 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2df8ca5c-93bd-4019-a103-12c3e8b4aeb0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:45.295315 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2df8ca5c-93bd-4019-a103-12c3e8b4aeb0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:45.388484 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-2df8ca5c-93bd-4019-a103-12c3e8b4aeb0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89aa18ddc71c4951bf15fcbd404912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51f9e52588e4008adf20f443c367b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:33:45.395927 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-2df8ca5c-93bd-4019-a103-12c3e8b4aeb0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 200 len: 1603 microversion: 2.1 time: 0.113521 Jul 27 04:33:45.396485 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 484/958] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:45 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 1603 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:33:45.470275 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-ffd64566-734f-441a-adba-56af64d022ee req-809ac51a-2dce-4bcd-987d-856c6c07c870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0d21bc-cb26-4062-92ef-e03a680c90c0", "name": "network-vif-deleted", "tag": "5349185d-2368-47e0-8150-20b7da691812"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:33:45.479799 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-ffd64566-734f-441a-adba-56af64d022ee req-809ac51a-2dce-4bcd-987d-856c6c07c870 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:45.480252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-ffd64566-734f-441a-adba-56af64d022ee req-809ac51a-2dce-4bcd-987d-856c6c07c870 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:45.491443 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:33:45.493786 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-ffd64566-734f-441a-adba-56af64d022ee req-809ac51a-2dce-4bcd-987d-856c6c07c870 service nova] Creating event network-vif-deleted:5349185d-2368-47e0-8150-20b7da691812 for instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 on hv-cinder-85098 Jul 27 04:33:45.499860 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-ffd64566-734f-441a-adba-56af64d022ee req-809ac51a-2dce-4bcd-987d-856c6c07c870 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035978 Jul 27 04:33:45.503055 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 475/959] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:33:46.419104 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c068854f-c1f7-477f-a6ab-6005661f44cf tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:46.419736 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c068854f-c1f7-477f-a6ab-6005661f44cf tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:46.426640 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c068854f-c1f7-477f-a6ab-6005661f44cf tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:46.427127 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c068854f-c1f7-477f-a6ab-6005661f44cf tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:46.427937 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c068854f-c1f7-477f-a6ab-6005661f44cf tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:46.428380 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c068854f-c1f7-477f-a6ab-6005661f44cf tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:46.442332 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-c068854f-c1f7-477f-a6ab-6005661f44cf tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] HTTP exception thrown: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c068854f-c1f7-477f-a6ab-6005661f44cf tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Request method failure captured: Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 HTTP/1.1 Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L8lfBkhfp4AJB-WxfQ8D_SBWJjTjDXU_wYuavVUzqVjCKqjJ9I4J6KS0oT7IaxU2VnC8Rz5k6u26eyHGH6MvS8OkE4MD-XwbNsqU5A5f-DHxSyA7JqsyslTUgyBjq-FiZJ_VNKVQealvM-K6UE4EMQMIL2SqXyz93cmkLaVQxDi8wE Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: e51f9e52588e4008adf20f443c367b02 Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:33:46.444019 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:33:46.445410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e51f9e52588e4008adf20f443c367b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:33:46.445410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:46.445410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: e51f9e52588e4008adf20f443c367b02 Jul 27 04:33:46.445410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:46.445410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeTestJSON-1412373030-project Jul 27 04:33:46.445410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:33:46.445410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:33:46.445410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 89aa18ddc71c4951bf15fcbd404912e9 Jul 27 04:33:46.445410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeTestJSON-1412373030-project Jul 27 04:33:46.445410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:33:46.445410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:46.445410 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '0a0d21bc-cb26-4062-92ef-e03a680c90c0'} Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:33:46.446430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:46.447687 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:46.449490 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c068854f-c1f7-477f-a6ab-6005661f44cf tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Returning 404 to user: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:33:46.449490 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c068854f-c1f7-477f-a6ab-6005661f44cf tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 404 len: 111 microversion: 2.1 time: 0.030256 Jul 27 04:33:46.449490 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 485/960] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:46 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 04:33:46.457506 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-b50a281a-4694-4d64-9929-bf97dd3786ec tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '.version_select at 0x7f21d5b3e5e0>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:46.482168 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-b50a281a-4694-4d64-9929-bf97dd3786ec tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-290216017" status: 202 len: 0 microversion: 2.1 time: 0.029675 Jul 27 04:33:46.482775 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 476/961] 10.222.0.46 () {58 vars in 1218 bytes} [Wed Jul 27 04:33:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-290216017 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:33:49.348128 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e6370836-ebdd-45ce-b969-78f2210eaea0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:49.348665 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e6370836-ebdd-45ce-b969-78f2210eaea0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:49.356917 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e6370836-ebdd-45ce-b969-78f2210eaea0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:49.357779 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e6370836-ebdd-45ce-b969-78f2210eaea0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:49.358728 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e6370836-ebdd-45ce-b969-78f2210eaea0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:49.359162 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e6370836-ebdd-45ce-b969-78f2210eaea0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:49.372901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-e6370836-ebdd-45ce-b969-78f2210eaea0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] HTTP exception thrown: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e6370836-ebdd-45ce-b969-78f2210eaea0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Request method failure captured: Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: DELETE /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 HTTP/1.1 Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L8lfBkhfp4AJB-WxfQ8D_SBWJjTjDXU_wYuavVUzqVjCKqjJ9I4J6KS0oT7IaxU2VnC8Rz5k6u26eyHGH6MvS8OkE4MD-XwbNsqU5A5f-DHxSyA7JqsyslTUgyBjq-FiZJ_VNKVQealvM-K6UE4EMQMIL2SqXyz93cmkLaVQxDi8wE Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: e51f9e52588e4008adf20f443c367b02 Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:33:49.374456 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:33:49.376419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e51f9e52588e4008adf20f443c367b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:33:49.376419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:49.376419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: e51f9e52588e4008adf20f443c367b02 Jul 27 04:33:49.376419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:49.376419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeTestJSON-1412373030-project Jul 27 04:33:49.376419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:33:49.376419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:33:49.376419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 89aa18ddc71c4951bf15fcbd404912e9 Jul 27 04:33:49.376419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeTestJSON-1412373030-project Jul 27 04:33:49.376419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:33:49.376419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:49.376419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '0a0d21bc-cb26-4062-92ef-e03a680c90c0'} Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:33:49.377489 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:49.378986 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:49.380744 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e6370836-ebdd-45ce-b969-78f2210eaea0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Returning 404 to user: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:33:49.380744 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e6370836-ebdd-45ce-b969-78f2210eaea0 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 404 len: 111 microversion: 2.1 time: 0.031921 Jul 27 04:33:49.380744 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 486/962] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:33:49 2022] DELETE /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:33:49.384741 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-21042e97-6326-4aa2-8d51-104570a2e47b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:49.385549 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-21042e97-6326-4aa2-8d51-104570a2e47b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 0a0d21bc-cb26-4062-92ef-e03a680c90c0] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:49.392286 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-21042e97-6326-4aa2-8d51-104570a2e47b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:49.392735 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-21042e97-6326-4aa2-8d51-104570a2e47b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:49.393495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-21042e97-6326-4aa2-8d51-104570a2e47b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:49.393928 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-21042e97-6326-4aa2-8d51-104570a2e47b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:49.406756 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-21042e97-6326-4aa2-8d51-104570a2e47b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] HTTP exception thrown: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-21042e97-6326-4aa2-8d51-104570a2e47b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Request method failure captured: Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 HTTP/1.1 Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L8lfBkhfp4AJB-WxfQ8D_SBWJjTjDXU_wYuavVUzqVjCKqjJ9I4J6KS0oT7IaxU2VnC8Rz5k6u26eyHGH6MvS8OkE4MD-XwbNsqU5A5f-DHxSyA7JqsyslTUgyBjq-FiZJ_VNKVQealvM-K6UE4EMQMIL2SqXyz93cmkLaVQxDi8wE Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: e51f9e52588e4008adf20f443c367b02 Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:33:49.408413 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:33:49.409958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e51f9e52588e4008adf20f443c367b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:33:49.409958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:49.409958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: e51f9e52588e4008adf20f443c367b02 Jul 27 04:33:49.409958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:49.409958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-AttachVolumeTestJSON-1412373030-project Jul 27 04:33:49.409958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:33:49.409958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:33:49.409958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 89aa18ddc71c4951bf15fcbd404912e9 Jul 27 04:33:49.409958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-AttachVolumeTestJSON-1412373030-project Jul 27 04:33:49.409958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:33:49.409958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:49.409958 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '0a0d21bc-cb26-4062-92ef-e03a680c90c0'} Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:33:49.411129 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. Jul 27 04:33:49.412637 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:33:49.414145 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-21042e97-6326-4aa2-8d51-104570a2e47b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Returning 404 to user: Instance 0a0d21bc-cb26-4062-92ef-e03a680c90c0 could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:33:49.414145 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-21042e97-6326-4aa2-8d51-104570a2e47b tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0" status: 404 len: 111 microversion: 2.1 time: 0.029389 Jul 27 04:33:49.414145 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 477/963] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:49 2022] GET /compute/v2.1/servers/0a0d21bc-cb26-4062-92ef-e03a680c90c0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:33:50.549883 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1d48d2a7-2425-4105-941a-5d8d939845f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:50.550387 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-1d48d2a7-2425-4105-941a-5d8d939845f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:50.552793 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:33:50.558092 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1d48d2a7-2425-4105-941a-5d8d939845f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:50.558540 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1d48d2a7-2425-4105-941a-5d8d939845f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:50.559307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1d48d2a7-2425-4105-941a-5d8d939845f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:50.559746 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-1d48d2a7-2425-4105-941a-5d8d939845f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:50.574720 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-1d48d2a7-2425-4105-941a-5d8d939845f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] HTTP exception thrown: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1d48d2a7-2425-4105-941a-5d8d939845f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Request method failure captured: Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: DELETE /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 HTTP/1.1 Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4L8lfBkhfp4AJB-WxfQ8D_SBWJjTjDXU_wYuavVUzqVjCKqjJ9I4J6KS0oT7IaxU2VnC8Rz5k6u26eyHGH6MvS8OkE4MD-XwbNsqU5A5f-DHxSyA7JqsyslTUgyBjq-FiZJ_VNKVQealvM-K6UE4EMQMIL2SqXyz93cmkLaVQxDi8wE Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: e51f9e52588e4008adf20f443c367b02 Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:33:50.576323 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:33:50.578020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e51f9e52588e4008adf20f443c367b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:33:50.578020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:50.578020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: e51f9e52588e4008adf20f443c367b02 Jul 27 04:33:50.578020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:50.578020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-AttachVolumeTestJSON-1412373030-project Jul 27 04:33:50.578020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:33:50.578020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:33:50.578020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: 89aa18ddc71c4951bf15fcbd404912e9 Jul 27 04:33:50.578020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-AttachVolumeTestJSON-1412373030-project Jul 27 04:33:50.578020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:33:50.578020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:33:50.578020 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '066cbb5b-1fe9-4c3d-b721-8962ce4f9b53'} Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:33:50.578932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:33:50.580416 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:33:50.581860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-1d48d2a7-2425-4105-941a-5d8d939845f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Returning 404 to user: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:33:50.581860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-1d48d2a7-2425-4105-941a-5d8d939845f7 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "DELETE /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 404 len: 111 microversion: 2.1 time: 0.031617 Jul 27 04:33:50.581860 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 487/964] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:33:50 2022] DELETE /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:33:50.586010 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0285fb4a-0337-490b-b626-648df9a17b54 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:33:50.586619 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-0285fb4a-0337-490b-b626-648df9a17b54 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] [instance: 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:33:50.588964 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:33:50.595228 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0285fb4a-0337-490b-b626-648df9a17b54 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:50.595670 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0285fb4a-0337-490b-b626-648df9a17b54 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:50.596432 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0285fb4a-0337-490b-b626-648df9a17b54 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:33:50.596862 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-0285fb4a-0337-490b-b626-648df9a17b54 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:33:50.612395 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.wsgi [None req-0285fb4a-0337-490b-b626-648df9a17b54 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] HTTP exception thrown: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0285fb4a-0337-490b-b626-648df9a17b54 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Request method failure captured: Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: request: GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 HTTP/1.1 Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept: application/json Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Accept-Encoding: identity Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Connection: close Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Length: 0 Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Content-Type: application/json Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Host: 10.222.0.46 Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Openstack-System-Scope: None Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: User-Agent: python-urllib3/1.26.10 Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Auth-Token: gAAAAABi4L8lfBkhfp4AJB-WxfQ8D_SBWJjTjDXU_wYuavVUzqVjCKqjJ9I4J6KS0oT7IaxU2VnC8Rz5k6u26eyHGH6MvS8OkE4MD-XwbNsqU5A5f-DHxSyA7JqsyslTUgyBjq-FiZJ_VNKVQealvM-K6UE4EMQMIL2SqXyz93cmkLaVQxDi8wE Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Id: None Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Domain-Name: None Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Identity-Status: Confirmed Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Is-Admin-Project: True Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Id: default Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Domain-Name: Default Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Id: e51f9e52588e4008adf20f443c367b02 Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Project-Name: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Role: reader,member Jul 27 04:33:50.613909 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Roles: reader,member Jul 27 04:33:50.615526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e51f9e52588e4008adf20f443c367b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e51f9e52588e4008adf20f443c367b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:33:50.615526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:50.615526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Id: e51f9e52588e4008adf20f443c367b02 Jul 27 04:33:50.615526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1412373030 Jul 27 04:33:50.615526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User: tempest-AttachVolumeTestJSON-1412373030-project Jul 27 04:33:50.615526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Id: default Jul 27 04:33:50.615526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Domain-Name: Default Jul 27 04:33:50.615526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Id: 89aa18ddc71c4951bf15fcbd404912e9 Jul 27 04:33:50.615526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: X-User-Name: tempest-AttachVolumeTestJSON-1412373030-project Jul 27 04:33:50.615526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: method: > Jul 27 04:33:50.615526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: exception: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:33:50.615526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: action_args: {'id': '066cbb5b-1fe9-4c3d-b721-8962ce4f9b53'} Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:33:50.616312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. Jul 27 04:33:50.617696 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: ERROR nova.api.openstack.wsgi Jul 27 04:33:50.618933 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-0285fb4a-0337-490b-b626-648df9a17b54 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] Returning 404 to user: Instance 066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 could not be found. {{(pid=117739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:33:50.618933 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-0285fb4a-0337-490b-b626-648df9a17b54 tempest-AttachVolumeTestJSON-1412373030 tempest-AttachVolumeTestJSON-1412373030-project] 10.222.0.46 "GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53" status: 404 len: 111 microversion: 2.1 time: 0.033101 Jul 27 04:33:50.618933 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 478/965] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:33:50 2022] GET /compute/v2.1/servers/066cbb5b-1fe9-4c3d-b721-8962ce4f9b53 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:34:20.120866 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-836b07bc-a01d-40ef-81ee-2e3c75183aaf tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Action: 'create', calling method: .version_select at 0x7f21d5aa80d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1908369653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZHRe9AFiUujrv/FXO+alBccj+G5syzeyvLUh9ov9jIr5fvA5naOmB4t6ioRAHFi+tEgENePYFiu/NP/glcGDIIhG23rASEwiHlYhh3e5Ktaw1ANlMUE87QbuuafaCq6A=="}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:34:20.127277 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:34:20.127914 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:34:20.141209 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-836b07bc-a01d-40ef-81ee-2e3c75183aaf tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Getting quotas for project 1241f54e5ce2416783c5a401e3eded2a. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:34:20.144963 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.quota [None req-836b07bc-a01d-40ef-81ee-2e3c75183aaf tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Getting quotas for user f92df6bb851642769a0b7d7b92f5973a and project 1241f54e5ce2416783c5a401e3eded2a. Resources: {'key_pairs'} {{(pid=117740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:34:20.167289 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-836b07bc-a01d-40ef-81ee-2e3c75183aaf tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050221 Jul 27 04:34:20.167885 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 488/966] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Jul 27 04:34:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:34:20.219015 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1973467059", "imageRef": "0fdcf52b-2b83-4819-8f9b-d0f05e4d3e92", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1908369653", "networks": [{"uuid": "33519493-7676-40a4-b41d-bed276bd4e15"}]}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:34:20.227504 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=4 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:34:20.228139 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=1 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:34:20.273815 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.network.neutron [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] validate_networks() for [('33519493-7676-40a4-b41d-bed276bd4e15', None, None, None, None, None)] {{(pid=117739) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 04:34:20.890290 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Flavor limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 04:34:20.890705 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Image limits 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 04:34:20.891170 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Flavor pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 04:34:20.891591 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Image pref 0:0:0 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 04:34:20.891967 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.virt.hardware [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 04:34:20.900851 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:20.901285 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:20.902103 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:20.902534 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:20.919715 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Getting quotas for project 1241f54e5ce2416783c5a401e3eded2a. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 04:34:20.923593 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.quota [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Getting quotas for user f92df6bb851642769a0b7d7b92f5973a and project 1241f54e5ce2416783c5a401e3eded2a. Resources: {'instances', 'ram', 'cores'} {{(pid=117739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 04:34:20.934239 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Going to run 1 instances... {{(pid=117739) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 04:34:20.936510 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0fdcf52b-2b83-4819-8f9b-d0f05e4d3e92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 04:34:20.981319 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-1158b3a8-75e5-405e-9871-a44fa1252b4b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766093 Jul 27 04:34:20.982022 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 479/967] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Jul 27 04:34:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 04:34:20.992957 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b318acea-b254-49d1-b300-c374a10984ae tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:20.994295 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b318acea-b254-49d1-b300-c374a10984ae tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:21.052606 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b318acea-b254-49d1-b300-c374a10984ae tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:21.060716 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b318acea-b254-49d1-b300-c374a10984ae tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1259 microversion: 2.1 time: 0.071109 Jul 27 04:34:21.061382 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 489/968] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:20 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:22.082648 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-978404a0-eaa8-4ab6-a82c-014885af5b30 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:22.083564 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-978404a0-eaa8-4ab6-a82c-014885af5b30 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:22.091273 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-978404a0-eaa8-4ab6-a82c-014885af5b30 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:22.091730 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-978404a0-eaa8-4ab6-a82c-014885af5b30 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:22.092516 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-978404a0-eaa8-4ab6-a82c-014885af5b30 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:22.092955 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-978404a0-eaa8-4ab6-a82c-014885af5b30 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:22.159848 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-978404a0-eaa8-4ab6-a82c-014885af5b30 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:22.167547 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-978404a0-eaa8-4ab6-a82c-014885af5b30 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1317 microversion: 2.1 time: 0.089406 Jul 27 04:34:22.169931 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 480/969] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:22 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1317 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:23.190103 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b67ae2da-a7c0-4823-9a33-ac373787f4fd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:23.190935 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b67ae2da-a7c0-4823-9a33-ac373787f4fd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:23.197617 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b67ae2da-a7c0-4823-9a33-ac373787f4fd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:23.198175 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b67ae2da-a7c0-4823-9a33-ac373787f4fd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:23.199017 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b67ae2da-a7c0-4823-9a33-ac373787f4fd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:23.199854 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b67ae2da-a7c0-4823-9a33-ac373787f4fd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:23.341519 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b67ae2da-a7c0-4823-9a33-ac373787f4fd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:23.349219 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b67ae2da-a7c0-4823-9a33-ac373787f4fd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.163085 Jul 27 04:34:23.349777 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 490/970] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:23 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:24.369943 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-54872bfb-219f-41e2-8b8c-05082052670c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:24.370868 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-54872bfb-219f-41e2-8b8c-05082052670c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:24.378391 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-54872bfb-219f-41e2-8b8c-05082052670c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:24.378967 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-54872bfb-219f-41e2-8b8c-05082052670c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:24.379987 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-54872bfb-219f-41e2-8b8c-05082052670c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:24.380566 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-54872bfb-219f-41e2-8b8c-05082052670c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:24.530380 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-54872bfb-219f-41e2-8b8c-05082052670c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:24.537653 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-54872bfb-219f-41e2-8b8c-05082052670c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.171786 Jul 27 04:34:24.538236 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 481/971] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:24 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:25.558669 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-e41a4e51-3559-4321-9e45-b3fb30356af1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:25.559276 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-e41a4e51-3559-4321-9e45-b3fb30356af1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:25.567058 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e41a4e51-3559-4321-9e45-b3fb30356af1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:25.567503 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e41a4e51-3559-4321-9e45-b3fb30356af1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:25.568278 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e41a4e51-3559-4321-9e45-b3fb30356af1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:25.569319 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-e41a4e51-3559-4321-9e45-b3fb30356af1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:25.708629 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-e41a4e51-3559-4321-9e45-b3fb30356af1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:25.716624 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-e41a4e51-3559-4321-9e45-b3fb30356af1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.161554 Jul 27 04:34:25.717488 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 491/972] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:25 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:26.736732 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-02b1f4a4-b38d-4974-ad3c-c634902a812a tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:26.737352 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-02b1f4a4-b38d-4974-ad3c-c634902a812a tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:26.743743 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-02b1f4a4-b38d-4974-ad3c-c634902a812a tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:26.744184 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-02b1f4a4-b38d-4974-ad3c-c634902a812a tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:26.744939 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-02b1f4a4-b38d-4974-ad3c-c634902a812a tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:26.745405 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-02b1f4a4-b38d-4974-ad3c-c634902a812a tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:26.892771 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-02b1f4a4-b38d-4974-ad3c-c634902a812a tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:26.901198 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-02b1f4a4-b38d-4974-ad3c-c634902a812a tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.168336 Jul 27 04:34:26.901964 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 482/973] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:26 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:27.922360 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-69576f02-d96d-4439-9084-c81835672181 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:27.923097 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-69576f02-d96d-4439-9084-c81835672181 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:27.929388 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-69576f02-d96d-4439-9084-c81835672181 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:27.929891 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-69576f02-d96d-4439-9084-c81835672181 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:27.930647 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-69576f02-d96d-4439-9084-c81835672181 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:27.931048 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-69576f02-d96d-4439-9084-c81835672181 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:28.073702 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-69576f02-d96d-4439-9084-c81835672181 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:28.082903 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-69576f02-d96d-4439-9084-c81835672181 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.164711 Jul 27 04:34:28.083566 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 492/974] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:27 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:29.104211 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6fd3638f-1a54-4650-8da4-bf626f8e1d76 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:29.104945 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6fd3638f-1a54-4650-8da4-bf626f8e1d76 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:29.112005 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6fd3638f-1a54-4650-8da4-bf626f8e1d76 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:29.112452 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6fd3638f-1a54-4650-8da4-bf626f8e1d76 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:29.113223 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6fd3638f-1a54-4650-8da4-bf626f8e1d76 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:29.113657 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6fd3638f-1a54-4650-8da4-bf626f8e1d76 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:29.256123 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-6fd3638f-1a54-4650-8da4-bf626f8e1d76 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:29.264182 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6fd3638f-1a54-4650-8da4-bf626f8e1d76 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.163793 Jul 27 04:34:29.265079 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 483/975] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:29 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:30.285256 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b4138bba-14ee-4ff3-a2cf-dbfdfc36e677 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:30.285831 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b4138bba-14ee-4ff3-a2cf-dbfdfc36e677 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:30.292360 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b4138bba-14ee-4ff3-a2cf-dbfdfc36e677 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:30.292808 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b4138bba-14ee-4ff3-a2cf-dbfdfc36e677 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:30.293567 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b4138bba-14ee-4ff3-a2cf-dbfdfc36e677 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:30.294604 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b4138bba-14ee-4ff3-a2cf-dbfdfc36e677 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:30.423344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b4138bba-14ee-4ff3-a2cf-dbfdfc36e677 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:30.431000 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b4138bba-14ee-4ff3-a2cf-dbfdfc36e677 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.149802 Jul 27 04:34:30.431562 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 493/976] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:30 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:31.089475 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-8f39ae66-7853-4d3b-961b-3e7ea267768a req-1f513998-db86-4a52-b374-2ad4cb30ede6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cec6f2d-6654-4661-bf6b-27950496d5b7", "tag": "75a5a121-f042-4322-a52a-a2c9a18e85b2"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:34:31.100507 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=2 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:34:31.101309 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell0:SELECT=6 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:34:31.104252 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-8f39ae66-7853-4d3b-961b-3e7ea267768a req-1f513998-db86-4a52-b374-2ad4cb30ede6 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:31.105524 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-8f39ae66-7853-4d3b-961b-3e7ea267768a req-1f513998-db86-4a52-b374-2ad4cb30ede6 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:31.119719 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-8f39ae66-7853-4d3b-961b-3e7ea267768a req-1f513998-db86-4a52-b374-2ad4cb30ede6 service nova] Creating event network-changed:75a5a121-f042-4322-a52a-a2c9a18e85b2 for instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 on hv-cinder-85098 Jul 27 04:34:31.126224 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-8f39ae66-7853-4d3b-961b-3e7ea267768a req-1f513998-db86-4a52-b374-2ad4cb30ede6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043136 Jul 27 04:34:31.126814 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 484/977] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:34:31.451394 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-4c282167-3f40-486e-a0cb-c59f564ba3de tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:31.452205 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-4c282167-3f40-486e-a0cb-c59f564ba3de tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:31.454189 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=6 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:34:31.460386 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4c282167-3f40-486e-a0cb-c59f564ba3de tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:31.460837 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4c282167-3f40-486e-a0cb-c59f564ba3de tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:31.461621 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4c282167-3f40-486e-a0cb-c59f564ba3de tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:31.462095 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-4c282167-3f40-486e-a0cb-c59f564ba3de tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:31.598374 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-4c282167-3f40-486e-a0cb-c59f564ba3de tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:31.608234 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-4c282167-3f40-486e-a0cb-c59f564ba3de tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.160890 Jul 27 04:34:31.610114 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 494/978] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:31 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:32.630376 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-261f5595-3716-4873-9d8a-fa52d2d3c125 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:32.631076 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-261f5595-3716-4873-9d8a-fa52d2d3c125 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:32.637167 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-261f5595-3716-4873-9d8a-fa52d2d3c125 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:32.637615 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-261f5595-3716-4873-9d8a-fa52d2d3c125 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:32.639071 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-261f5595-3716-4873-9d8a-fa52d2d3c125 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:32.639502 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-261f5595-3716-4873-9d8a-fa52d2d3c125 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:32.769040 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-261f5595-3716-4873-9d8a-fa52d2d3c125 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:32.776923 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-261f5595-3716-4873-9d8a-fa52d2d3c125 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.150944 Jul 27 04:34:32.777491 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 485/979] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:32 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:33.798773 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-b6d695e5-c640-4c00-bea3-f06360694eed tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:33.799307 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-b6d695e5-c640-4c00-bea3-f06360694eed tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:33.805766 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b6d695e5-c640-4c00-bea3-f06360694eed tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:33.806275 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b6d695e5-c640-4c00-bea3-f06360694eed tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:33.807047 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b6d695e5-c640-4c00-bea3-f06360694eed tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:33.807485 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-b6d695e5-c640-4c00-bea3-f06360694eed tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:33.937176 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-b6d695e5-c640-4c00-bea3-f06360694eed tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:33.944636 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-b6d695e5-c640-4c00-bea3-f06360694eed tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.150026 Jul 27 04:34:33.945202 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 495/980] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:33 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:34.965719 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-80dcecdb-3bff-4a3b-bdbf-e08362641846 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:34.966431 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-80dcecdb-3bff-4a3b-bdbf-e08362641846 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:34.973148 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-80dcecdb-3bff-4a3b-bdbf-e08362641846 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:34.973599 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-80dcecdb-3bff-4a3b-bdbf-e08362641846 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:34.974470 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-80dcecdb-3bff-4a3b-bdbf-e08362641846 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:34.974910 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-80dcecdb-3bff-4a3b-bdbf-e08362641846 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:35.103133 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-80dcecdb-3bff-4a3b-bdbf-e08362641846 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:35.111408 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-80dcecdb-3bff-4a3b-bdbf-e08362641846 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.149699 Jul 27 04:34:35.112004 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 486/981] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:34 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:36.132645 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ec30afa1-6190-431b-9da9-629351805e54 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:36.133295 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ec30afa1-6190-431b-9da9-629351805e54 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:36.140454 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ec30afa1-6190-431b-9da9-629351805e54 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:36.140901 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ec30afa1-6190-431b-9da9-629351805e54 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:36.141669 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ec30afa1-6190-431b-9da9-629351805e54 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:36.142136 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ec30afa1-6190-431b-9da9-629351805e54 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:36.275135 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ec30afa1-6190-431b-9da9-629351805e54 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:36.282978 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ec30afa1-6190-431b-9da9-629351805e54 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.154250 Jul 27 04:34:36.283545 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 496/982] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:36 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:37.229262 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-cd849e6e-7e87-4e58-bd3d-9b7e10817b29 req-58e8184c-2e2c-4c88-b6cd-ad7c0342a729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cec6f2d-6654-4661-bf6b-27950496d5b7", "name": "network-vif-plugged", "status": "completed", "tag": "75a5a121-f042-4322-a52a-a2c9a18e85b2"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:34:37.239842 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-cd849e6e-7e87-4e58-bd3d-9b7e10817b29 req-58e8184c-2e2c-4c88-b6cd-ad7c0342a729 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:37.240274 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-cd849e6e-7e87-4e58-bd3d-9b7e10817b29 req-58e8184c-2e2c-4c88-b6cd-ad7c0342a729 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:37.253881 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-cd849e6e-7e87-4e58-bd3d-9b7e10817b29 req-58e8184c-2e2c-4c88-b6cd-ad7c0342a729 service nova] Creating event network-vif-plugged:75a5a121-f042-4322-a52a-a2c9a18e85b2 for instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 on hv-cinder-85098 Jul 27 04:34:37.258609 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-cd849e6e-7e87-4e58-bd3d-9b7e10817b29 req-58e8184c-2e2c-4c88-b6cd-ad7c0342a729 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032991 Jul 27 04:34:37.259361 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 487/983] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:34:37.303874 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-abaecccf-892d-4ace-8b27-b5f22bd786a9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:37.304492 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-abaecccf-892d-4ace-8b27-b5f22bd786a9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:37.311890 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-abaecccf-892d-4ace-8b27-b5f22bd786a9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:37.312344 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-abaecccf-892d-4ace-8b27-b5f22bd786a9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:37.313107 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-abaecccf-892d-4ace-8b27-b5f22bd786a9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:37.313620 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-abaecccf-892d-4ace-8b27-b5f22bd786a9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:37.488396 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-abaecccf-892d-4ace-8b27-b5f22bd786a9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:37.495789 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-abaecccf-892d-4ace-8b27-b5f22bd786a9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.195785 Jul 27 04:34:37.496347 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 497/984] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:37 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:38.517823 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-e590d12b-9e50-4cd7-af76-63d686e80c09 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:38.518548 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-e590d12b-9e50-4cd7-af76-63d686e80c09 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:38.524650 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e590d12b-9e50-4cd7-af76-63d686e80c09 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:38.525088 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e590d12b-9e50-4cd7-af76-63d686e80c09 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:38.525842 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e590d12b-9e50-4cd7-af76-63d686e80c09 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:38.526294 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-e590d12b-9e50-4cd7-af76-63d686e80c09 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:38.657180 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-e590d12b-9e50-4cd7-af76-63d686e80c09 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:38.664476 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-e590d12b-9e50-4cd7-af76-63d686e80c09 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1359 microversion: 2.1 time: 0.151534 Jul 27 04:34:38.665033 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 488/985] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:38 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:39.687132 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0a7bc5bc-d2bb-4bbe-aa17-84a87ba4022e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:39.687746 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0a7bc5bc-d2bb-4bbe-aa17-84a87ba4022e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:39.694170 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0a7bc5bc-d2bb-4bbe-aa17-84a87ba4022e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:39.694617 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0a7bc5bc-d2bb-4bbe-aa17-84a87ba4022e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:39.695378 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0a7bc5bc-d2bb-4bbe-aa17-84a87ba4022e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:39.695814 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0a7bc5bc-d2bb-4bbe-aa17-84a87ba4022e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:39.823481 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0a7bc5bc-d2bb-4bbe-aa17-84a87ba4022e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:39.831749 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0a7bc5bc-d2bb-4bbe-aa17-84a87ba4022e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1549 microversion: 2.1 time: 0.149422 Jul 27 04:34:39.832316 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 498/986] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:39 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:39.851883 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-5e9709cd-c69f-451d-80a7-d0a9c3b48158 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:39.852495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-5e9709cd-c69f-451d-80a7-d0a9c3b48158 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:39.859003 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5e9709cd-c69f-451d-80a7-d0a9c3b48158 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:39.859452 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5e9709cd-c69f-451d-80a7-d0a9c3b48158 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:39.860212 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5e9709cd-c69f-451d-80a7-d0a9c3b48158 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:39.860647 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-5e9709cd-c69f-451d-80a7-d0a9c3b48158 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:39.985899 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-5e9709cd-c69f-451d-80a7-d0a9c3b48158 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:39.993249 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-5e9709cd-c69f-451d-80a7-d0a9c3b48158 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1549 microversion: 2.1 time: 0.145158 Jul 27 04:34:39.993803 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 489/987] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:39 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1549 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:40.013809 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-ebce45bd-182f-4bbf-99ba-d4ff230edaa1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:40.018633 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-ebce45bd-182f-4bbf-99ba-d4ff230edaa1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:40.019297 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-ebce45bd-182f-4bbf-99ba-d4ff230edaa1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Searching by: {'deleted': False, 'project_id': '1241f54e5ce2416783c5a401e3eded2a'} {{(pid=117740) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 27 04:34:40.025932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ebce45bd-182f-4bbf-99ba-d4ff230edaa1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:40.026359 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ebce45bd-182f-4bbf-99ba-d4ff230edaa1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:40.027163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ebce45bd-182f-4bbf-99ba-d4ff230edaa1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:40.027600 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-ebce45bd-182f-4bbf-99ba-d4ff230edaa1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:40.116798 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.multi_cell_list [None req-ebce45bd-182f-4bbf-99ba-d4ff230edaa1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117740) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 27 04:34:40.208234 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-ebce45bd-182f-4bbf-99ba-d4ff230edaa1 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198802 Jul 27 04:34:40.208811 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 499/988] 10.222.0.46 () {58 vars in 1125 bytes} [Wed Jul 27 04:34:40 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:34:40.220178 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-8fc96772-c633-4b00-a978-804a04d4772e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:40.220778 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-8fc96772-c633-4b00-a978-804a04d4772e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:40.226654 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8fc96772-c633-4b00-a978-804a04d4772e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:40.228057 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8fc96772-c633-4b00-a978-804a04d4772e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:40.228812 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8fc96772-c633-4b00-a978-804a04d4772e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:40.229241 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-8fc96772-c633-4b00-a978-804a04d4772e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:40.355328 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-8fc96772-c633-4b00-a978-804a04d4772e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:40.363526 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-8fc96772-c633-4b00-a978-804a04d4772e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1549 microversion: 2.1 time: 0.147368 Jul 27 04:34:40.364115 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 490/989] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:40 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:41.893127 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7081668c-48d7-4d45-ba1c-02fbb7ab3992 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5934ac0-9837-41de-be22-9d2a19d86654"}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:34:41.895473 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-7081668c-48d7-4d45-ba1c-02fbb7ab3992 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:41.901845 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7081668c-48d7-4d45-ba1c-02fbb7ab3992 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:41.902320 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7081668c-48d7-4d45-ba1c-02fbb7ab3992 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:41.903074 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7081668c-48d7-4d45-ba1c-02fbb7ab3992 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:41.903529 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7081668c-48d7-4d45-ba1c-02fbb7ab3992 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:42.131198 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-7081668c-48d7-4d45-ba1c-02fbb7ab3992 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "POST /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241700 Jul 27 04:34:42.131760 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 500/990] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Jul 27 04:34:41 2022] POST /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/os-volume_attachments => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:34:48.648449 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-bd915e0a-006e-4f30-bd1e-acb958303c6c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:48.649087 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-bd915e0a-006e-4f30-bd1e-acb958303c6c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:48.655808 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bd915e0a-006e-4f30-bd1e-acb958303c6c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:48.656262 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bd915e0a-006e-4f30-bd1e-acb958303c6c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:48.657032 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bd915e0a-006e-4f30-bd1e-acb958303c6c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:48.657470 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-bd915e0a-006e-4f30-bd1e-acb958303c6c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:48.789652 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-bd915e0a-006e-4f30-bd1e-acb958303c6c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:48.798264 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-bd915e0a-006e-4f30-bd1e-acb958303c6c tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1595 microversion: 2.1 time: 0.153604 Jul 27 04:34:48.798829 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 491/991] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:48 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1595 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:50.442663 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell0:SELECT=2 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:34:50.447046 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-6bb46b68-6e2e-4a03-8360-ad6554e8a0b6 req-d8599952-0b99-4fd9-8023-3a0a8108b65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cec6f2d-6654-4661-bf6b-27950496d5b7", "tag": "75a5a121-f042-4322-a52a-a2c9a18e85b2"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:34:50.460408 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:34:50.465112 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-6bb46b68-6e2e-4a03-8360-ad6554e8a0b6 req-d8599952-0b99-4fd9-8023-3a0a8108b65c service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:50.466433 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-6bb46b68-6e2e-4a03-8360-ad6554e8a0b6 req-d8599952-0b99-4fd9-8023-3a0a8108b65c service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:50.471806 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:34:50.482844 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-6bb46b68-6e2e-4a03-8360-ad6554e8a0b6 req-d8599952-0b99-4fd9-8023-3a0a8108b65c service nova] Creating event network-changed:75a5a121-f042-4322-a52a-a2c9a18e85b2 for instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 on hv-cinder-85098 Jul 27 04:34:50.489429 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-6bb46b68-6e2e-4a03-8360-ad6554e8a0b6 req-d8599952-0b99-4fd9-8023-3a0a8108b65c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047945 Jul 27 04:34:50.490423 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 501/992] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:34:51.515880 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d8d080f8-663e-4936-87c4-3293518b03e0 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-669744270"}} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:34:51.516777 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d8d080f8-663e-4936-87c4-3293518b03e0 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:51.518860 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:34:51.524649 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d8d080f8-663e-4936-87c4-3293518b03e0 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:51.525096 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d8d080f8-663e-4936-87c4-3293518b03e0 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:51.525873 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d8d080f8-663e-4936-87c4-3293518b03e0 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:51.526339 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d8d080f8-663e-4936-87c4-3293518b03e0 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:51.529934 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=67 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:34:51.664046 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.network.security_group_api [None req-d8d080f8-663e-4936-87c4-3293518b03e0 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Adding security group ba5084bb-c1a6-4e4c-84f6-06e1fea5abc7 to port 75a5a121-f042-4322-a52a-a2c9a18e85b2 Jul 27 04:34:52.009379 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d8d080f8-663e-4936-87c4-3293518b03e0 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "POST /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/action" status: 202 len: 0 microversion: 2.1 time: 0.498617 Jul 27 04:34:52.012995 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 492/993] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:34:51 2022] POST /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:34:52.020066 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-53d0927a-c5d3-4ceb-a01d-db36cf14eaaa tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:34:52.021057 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-53d0927a-c5d3-4ceb-a01d-db36cf14eaaa tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:34:52.032012 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-53d0927a-c5d3-4ceb-a01d-db36cf14eaaa tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:52.039012 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-53d0927a-c5d3-4ceb-a01d-db36cf14eaaa tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:52.040727 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-53d0927a-c5d3-4ceb-a01d-db36cf14eaaa tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:52.041783 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-53d0927a-c5d3-4ceb-a01d-db36cf14eaaa tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:52.206040 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-53d0927a-c5d3-4ceb-a01d-db36cf14eaaa tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:34:52.214357 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-53d0927a-c5d3-4ceb-a01d-db36cf14eaaa tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1759 microversion: 2.1 time: 0.199289 Jul 27 04:34:52.214929 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 502/994] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:34:52 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1759 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:34:52.504998 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-2e0f8bc5-5914-47c6-b6b3-9a66babd8dd4 req-4d624225-06d4-4044-93b9-e84c6392d701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cec6f2d-6654-4661-bf6b-27950496d5b7", "tag": "75a5a121-f042-4322-a52a-a2c9a18e85b2"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:34:52.515319 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-2e0f8bc5-5914-47c6-b6b3-9a66babd8dd4 req-4d624225-06d4-4044-93b9-e84c6392d701 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:34:52.515763 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-2e0f8bc5-5914-47c6-b6b3-9a66babd8dd4 req-4d624225-06d4-4044-93b9-e84c6392d701 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:34:52.527227 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-2e0f8bc5-5914-47c6-b6b3-9a66babd8dd4 req-4d624225-06d4-4044-93b9-e84c6392d701 service nova] Creating event network-changed:75a5a121-f042-4322-a52a-a2c9a18e85b2 for instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 on hv-cinder-85098 Jul 27 04:34:52.533361 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-2e0f8bc5-5914-47c6-b6b3-9a66babd8dd4 req-4d624225-06d4-4044-93b9-e84c6392d701 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032044 Jul 27 04:34:52.534096 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 493/995] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:35:14.554824 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-82d37a51-ea38-44cb-bd10-ac56743a8620 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:35:14.557012 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-82d37a51-ea38-44cb-bd10-ac56743a8620 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:35:14.560008 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=3 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:35:14.560874 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=7 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:35:14.566330 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-82d37a51-ea38-44cb-bd10-ac56743a8620 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:14.566772 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-82d37a51-ea38-44cb-bd10-ac56743a8620 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:14.567532 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-82d37a51-ea38-44cb-bd10-ac56743a8620 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:14.567962 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-82d37a51-ea38-44cb-bd10-ac56743a8620 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:14.638277 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-82d37a51-ea38-44cb-bd10-ac56743a8620 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "POST /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/action" status: 202 len: 0 microversion: 2.1 time: 0.086185 Jul 27 04:35:14.638929 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 503/996] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:35:14 2022] POST /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:35:14.644980 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=3 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:35:14.645721 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=5 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:35:14.649992 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-9df6029d-dca0-478a-a1a3-3ae319cb3da8 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:35:14.650751 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-9df6029d-dca0-478a-a1a3-3ae319cb3da8 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:35:14.658465 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9df6029d-dca0-478a-a1a3-3ae319cb3da8 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:14.658912 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9df6029d-dca0-478a-a1a3-3ae319cb3da8 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:14.659770 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9df6029d-dca0-478a-a1a3-3ae319cb3da8 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:14.660216 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-9df6029d-dca0-478a-a1a3-3ae319cb3da8 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:14.813215 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-9df6029d-dca0-478a-a1a3-3ae319cb3da8 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:35:14.821479 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-9df6029d-dca0-478a-a1a3-3ae319cb3da8 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1751 microversion: 2.1 time: 0.177847 Jul 27 04:35:14.822340 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 494/997] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:35:14 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:35:15.845595 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-bb68eede-b13f-4cb0-8217-ad778c7423bc tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:35:15.846310 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-bb68eede-b13f-4cb0-8217-ad778c7423bc tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:35:15.852397 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bb68eede-b13f-4cb0-8217-ad778c7423bc tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:15.852838 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bb68eede-b13f-4cb0-8217-ad778c7423bc tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:15.853584 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bb68eede-b13f-4cb0-8217-ad778c7423bc tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:15.854036 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-bb68eede-b13f-4cb0-8217-ad778c7423bc tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:15.997359 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-bb68eede-b13f-4cb0-8217-ad778c7423bc tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:35:16.005186 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-bb68eede-b13f-4cb0-8217-ad778c7423bc tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1756 microversion: 2.1 time: 0.164360 Jul 27 04:35:16.005746 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 504/998] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:35:15 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:35:17.027390 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-2ef89832-b42b-4b56-a7ee-6c0ab7c225f2 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:35:17.028903 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-2ef89832-b42b-4b56-a7ee-6c0ab7c225f2 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:35:17.035495 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2ef89832-b42b-4b56-a7ee-6c0ab7c225f2 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:17.035944 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2ef89832-b42b-4b56-a7ee-6c0ab7c225f2 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:17.036711 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2ef89832-b42b-4b56-a7ee-6c0ab7c225f2 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:17.037142 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-2ef89832-b42b-4b56-a7ee-6c0ab7c225f2 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:17.182011 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-2ef89832-b42b-4b56-a7ee-6c0ab7c225f2 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:35:17.190246 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-2ef89832-b42b-4b56-a7ee-6c0ab7c225f2 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1756 microversion: 2.1 time: 0.166673 Jul 27 04:35:17.190803 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 495/999] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:35:17 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:35:18.212419 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-f169cc86-bae0-4de3-9229-8426e160b1b7 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:35:18.213027 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-f169cc86-bae0-4de3-9229-8426e160b1b7 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:35:18.219967 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f169cc86-bae0-4de3-9229-8426e160b1b7 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:18.220409 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f169cc86-bae0-4de3-9229-8426e160b1b7 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:18.221163 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f169cc86-bae0-4de3-9229-8426e160b1b7 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:18.221589 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-f169cc86-bae0-4de3-9229-8426e160b1b7 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:18.366389 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-f169cc86-bae0-4de3-9229-8426e160b1b7 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:35:18.375739 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-f169cc86-bae0-4de3-9229-8426e160b1b7 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1756 microversion: 2.1 time: 0.167155 Jul 27 04:35:18.376594 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 505/1000] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:35:18 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:35:19.398341 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-3bcf2963-8d61-4b45-a9ae-c5b7cf8204e3 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:35:19.398947 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-3bcf2963-8d61-4b45-a9ae-c5b7cf8204e3 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:35:19.405716 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3bcf2963-8d61-4b45-a9ae-c5b7cf8204e3 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:19.406211 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3bcf2963-8d61-4b45-a9ae-c5b7cf8204e3 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:19.406983 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3bcf2963-8d61-4b45-a9ae-c5b7cf8204e3 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:19.407423 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-3bcf2963-8d61-4b45-a9ae-c5b7cf8204e3 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:19.550615 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-3bcf2963-8d61-4b45-a9ae-c5b7cf8204e3 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:35:19.558492 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-3bcf2963-8d61-4b45-a9ae-c5b7cf8204e3 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1756 microversion: 2.1 time: 0.163950 Jul 27 04:35:19.559047 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 496/1001] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:35:19 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:35:20.580396 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0308b38d-ab6e-4416-b2d6-de38286a87d9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:35:20.581006 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0308b38d-ab6e-4416-b2d6-de38286a87d9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:35:20.587405 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0308b38d-ab6e-4416-b2d6-de38286a87d9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:20.587875 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0308b38d-ab6e-4416-b2d6-de38286a87d9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:20.588626 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0308b38d-ab6e-4416-b2d6-de38286a87d9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:20.589058 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0308b38d-ab6e-4416-b2d6-de38286a87d9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:20.728928 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0308b38d-ab6e-4416-b2d6-de38286a87d9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:35:20.736765 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0308b38d-ab6e-4416-b2d6-de38286a87d9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1756 microversion: 2.1 time: 0.160260 Jul 27 04:35:20.737318 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 506/1002] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:35:20 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:35:21.757077 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-99a929ab-ffd1-4803-9d15-03ab3d6d336e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:35:21.757658 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-99a929ab-ffd1-4803-9d15-03ab3d6d336e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:35:21.764736 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-99a929ab-ffd1-4803-9d15-03ab3d6d336e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:21.765201 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-99a929ab-ffd1-4803-9d15-03ab3d6d336e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:21.765950 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-99a929ab-ffd1-4803-9d15-03ab3d6d336e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:21.766411 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-99a929ab-ffd1-4803-9d15-03ab3d6d336e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:21.905654 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-99a929ab-ffd1-4803-9d15-03ab3d6d336e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:35:21.913403 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-99a929ab-ffd1-4803-9d15-03ab3d6d336e tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1756 microversion: 2.1 time: 0.160278 Jul 27 04:35:21.913962 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 497/1003] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:35:21 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:35:22.936038 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-0e42c0de-d05c-48c7-b567-9f88bb111b9f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:35:22.936685 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-0e42c0de-d05c-48c7-b567-9f88bb111b9f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:35:22.943244 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0e42c0de-d05c-48c7-b567-9f88bb111b9f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:22.943689 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0e42c0de-d05c-48c7-b567-9f88bb111b9f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:22.944443 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0e42c0de-d05c-48c7-b567-9f88bb111b9f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:22.944870 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-0e42c0de-d05c-48c7-b567-9f88bb111b9f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:23.093430 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-0e42c0de-d05c-48c7-b567-9f88bb111b9f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:35:23.101362 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-0e42c0de-d05c-48c7-b567-9f88bb111b9f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1756 microversion: 2.1 time: 0.169858 Jul 27 04:35:23.101932 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 507/1004] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:35:22 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:35:24.122984 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f863df20-78f0-44d7-92da-fabc84c8869f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:35:24.123616 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f863df20-78f0-44d7-92da-fabc84c8869f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:35:24.130575 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f863df20-78f0-44d7-92da-fabc84c8869f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:24.131021 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f863df20-78f0-44d7-92da-fabc84c8869f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:24.131776 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f863df20-78f0-44d7-92da-fabc84c8869f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:24.132209 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f863df20-78f0-44d7-92da-fabc84c8869f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:24.275512 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f863df20-78f0-44d7-92da-fabc84c8869f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:35:24.284077 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f863df20-78f0-44d7-92da-fabc84c8869f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1756 microversion: 2.1 time: 0.164927 Jul 27 04:35:24.284641 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 498/1005] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:35:24 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:35:25.305859 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-2f71bf09-6de4-4f57-b3f4-a9d465a0f2ae tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:35:25.306455 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-2f71bf09-6de4-4f57-b3f4-a9d465a0f2ae tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:35:25.313193 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2f71bf09-6de4-4f57-b3f4-a9d465a0f2ae tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:25.313639 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2f71bf09-6de4-4f57-b3f4-a9d465a0f2ae tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:25.314433 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2f71bf09-6de4-4f57-b3f4-a9d465a0f2ae tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:25.314868 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-2f71bf09-6de4-4f57-b3f4-a9d465a0f2ae tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:25.460658 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-2f71bf09-6de4-4f57-b3f4-a9d465a0f2ae tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:35:25.469678 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-2f71bf09-6de4-4f57-b3f4-a9d465a0f2ae tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1756 microversion: 2.1 time: 0.167701 Jul 27 04:35:25.472121 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 508/1006] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:35:25 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:35:26.490455 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-d667e00e-204a-441a-8bf0-42cc6a89f31f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:35:26.491060 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-d667e00e-204a-441a-8bf0-42cc6a89f31f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:35:26.497547 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d667e00e-204a-441a-8bf0-42cc6a89f31f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:26.497994 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d667e00e-204a-441a-8bf0-42cc6a89f31f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:26.499299 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d667e00e-204a-441a-8bf0-42cc6a89f31f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:26.499885 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-d667e00e-204a-441a-8bf0-42cc6a89f31f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:26.638751 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-d667e00e-204a-441a-8bf0-42cc6a89f31f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:35:26.647077 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-d667e00e-204a-441a-8bf0-42cc6a89f31f tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1759 microversion: 2.1 time: 0.160527 Jul 27 04:35:26.647630 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 499/1007] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:35:26 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1759 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:35:59.441144 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-58108a29-fdf2-4574-9cf0-cd716525302b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-669744270"}} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:35:59.441739 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-58108a29-fdf2-4574-9cf0-cd716525302b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:35:59.443974 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_api:SELECT=12 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:35:59.444624 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG dbcounter [-] [117740] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:35:59.451040 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-58108a29-fdf2-4574-9cf0-cd716525302b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:59.451491 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-58108a29-fdf2-4574-9cf0-cd716525302b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:59.452266 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-58108a29-fdf2-4574-9cf0-cd716525302b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:59.452703 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-58108a29-fdf2-4574-9cf0-cd716525302b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:59.583550 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.network.security_group_api [None req-58108a29-fdf2-4574-9cf0-cd716525302b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Removing security group ba5084bb-c1a6-4e4c-84f6-06e1fea5abc7 from port 75a5a121-f042-4322-a52a-a2c9a18e85b2 Jul 27 04:35:59.913424 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-58108a29-fdf2-4574-9cf0-cd716525302b tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "POST /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/action" status: 202 len: 0 microversion: 2.1 time: 0.476645 Jul 27 04:35:59.926686 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 509/1008] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Jul 27 04:35:59 2022] POST /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:35:59.951624 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [req-4cab8055-7642-4adb-afd8-ed5b7d17431d req-ec43af64-2a0e-4b50-8199-1c295ced3326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cec6f2d-6654-4661-bf6b-27950496d5b7", "tag": "75a5a121-f042-4322-a52a-a2c9a18e85b2"}]} {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:35:59.965584 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_api:SELECT=12 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:35:59.966292 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG dbcounter [-] [117739] Writing DB stats nova_cell1:SELECT=36 {{(pid=117739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:35:59.974885 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-4cab8055-7642-4adb-afd8-ed5b7d17431d req-ec43af64-2a0e-4b50-8199-1c295ced3326 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:35:59.975335 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [req-4cab8055-7642-4adb-afd8-ed5b7d17431d req-ec43af64-2a0e-4b50-8199-1c295ced3326 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:35:59.996715 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.compute.server_external_events [req-4cab8055-7642-4adb-afd8-ed5b7d17431d req-ec43af64-2a0e-4b50-8199-1c295ced3326 service nova] Creating event network-changed:75a5a121-f042-4322-a52a-a2c9a18e85b2 for instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 on hv-cinder-85098 Jul 27 04:36:00.002312 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [req-4cab8055-7642-4adb-afd8-ed5b7d17431d req-ec43af64-2a0e-4b50-8199-1c295ced3326 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055039 Jul 27 04:36:00.004003 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 500/1009] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:36:01.394791 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-32ae627a-8f8e-42ba-883c-5441c82a5dfd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:36:01.395834 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-32ae627a-8f8e-42ba-883c-5441c82a5dfd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:36:01.402681 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-32ae627a-8f8e-42ba-883c-5441c82a5dfd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:01.403126 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-32ae627a-8f8e-42ba-883c-5441c82a5dfd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:01.403889 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-32ae627a-8f8e-42ba-883c-5441c82a5dfd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:01.404320 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-32ae627a-8f8e-42ba-883c-5441c82a5dfd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:01.490501 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.objects.instance [None req-32ae627a-8f8e-42ba-883c-5441c82a5dfd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lazy-loading 'services' on Instance uuid 1cec6f2d-6654-4661-bf6b-27950496d5b7 {{(pid=117740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:36:01.567010 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-32ae627a-8f8e-42ba-883c-5441c82a5dfd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/os-volume_attachments/c5934ac0-9837-41de-be22-9d2a19d86654" status: 202 len: 0 microversion: 2.1 time: 0.176433 Jul 27 04:36:01.567612 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 510/1010] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Jul 27 04:36:01 2022] DELETE /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/os-volume_attachments/c5934ac0-9837-41de-be22-9d2a19d86654 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:36:01.576962 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-42c77fdd-968f-4823-b693-939cf646a66d tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:36:01.580595 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-42c77fdd-968f-4823-b693-939cf646a66d tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:36:01.588653 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-42c77fdd-968f-4823-b693-939cf646a66d tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:01.589464 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-42c77fdd-968f-4823-b693-939cf646a66d tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:01.590265 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-42c77fdd-968f-4823-b693-939cf646a66d tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:01.590689 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-42c77fdd-968f-4823-b693-939cf646a66d tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:01.622940 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-42c77fdd-968f-4823-b693-939cf646a66d tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050510 Jul 27 04:36:01.623649 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 501/1011] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:36:01 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 04:36:02.018390 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-8c00a20c-c993-47f9-8605-f2c5f3ca99e0 req-1f042c17-857f-4abf-bf68-39fc33cb07a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cec6f2d-6654-4661-bf6b-27950496d5b7", "tag": "75a5a121-f042-4322-a52a-a2c9a18e85b2"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:36:02.029684 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-8c00a20c-c993-47f9-8605-f2c5f3ca99e0 req-1f042c17-857f-4abf-bf68-39fc33cb07a6 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:02.030332 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-8c00a20c-c993-47f9-8605-f2c5f3ca99e0 req-1f042c17-857f-4abf-bf68-39fc33cb07a6 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:02.043427 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-8c00a20c-c993-47f9-8605-f2c5f3ca99e0 req-1f042c17-857f-4abf-bf68-39fc33cb07a6 service nova] Creating event network-changed:75a5a121-f042-4322-a52a-a2c9a18e85b2 for instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 on hv-cinder-85098 Jul 27 04:36:02.050670 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-8c00a20c-c993-47f9-8605-f2c5f3ca99e0 req-1f042c17-857f-4abf-bf68-39fc33cb07a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036550 Jul 27 04:36:02.051384 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 511/1012] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:36:02.635855 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-7ef7f972-8169-46c0-acee-4c34b8e34369 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:36:02.638046 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-7ef7f972-8169-46c0-acee-4c34b8e34369 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:36:02.645264 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7ef7f972-8169-46c0-acee-4c34b8e34369 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:02.645717 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7ef7f972-8169-46c0-acee-4c34b8e34369 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:02.646523 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7ef7f972-8169-46c0-acee-4c34b8e34369 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:02.646960 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-7ef7f972-8169-46c0-acee-4c34b8e34369 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:02.677831 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-7ef7f972-8169-46c0-acee-4c34b8e34369 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046013 Jul 27 04:36:02.678452 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 502/1013] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Jul 27 04:36:02 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 04:36:02.689475 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7441cfb8-179d-4f5c-af28-51fdb5a36dd5 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:36:02.690157 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-7441cfb8-179d-4f5c-af28-51fdb5a36dd5 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:36:02.697723 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7441cfb8-179d-4f5c-af28-51fdb5a36dd5 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:02.698202 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7441cfb8-179d-4f5c-af28-51fdb5a36dd5 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:02.698976 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7441cfb8-179d-4f5c-af28-51fdb5a36dd5 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:02.699403 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-7441cfb8-179d-4f5c-af28-51fdb5a36dd5 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:02.777353 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-7441cfb8-179d-4f5c-af28-51fdb5a36dd5 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] HTTP exception thrown: Instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 is not attached to volume c5934ac0-9837-41de-be22-9d2a19d86654 Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7441cfb8-179d-4f5c-af28-51fdb5a36dd5 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Request method failure captured: Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: DELETE /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/os-volume_attachments/c5934ac0-9837-41de-be22-9d2a19d86654 HTTP/1.1 Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4MA-6C6UAWETm0kf85PBDGV_oBjvS9fu2YnqQbfwT2LbidAC4Puz772TEj3qXVKX7S3Xu7eFBo-yKUb7Qda8HuHcg4HhMR-bI1Z5k7VogAAZ_9kFcfQG0luTQuL2opJTe6feVHcy2mRi4x1PtvaGnBqRhjP3bommsIuPs2iSFHjlLeo Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 1241f54e5ce2416783c5a401e3eded2a Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-TestMinimumBasicScenario-1695342882 Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:36:02.779750 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:36:02.781530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1241f54e5ce2416783c5a401e3eded2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1241f54e5ce2416783c5a401e3eded2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1241f54e5ce2416783c5a401e3eded2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1241f54e5ce2416783c5a401e3eded2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:36:02.781530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-TestMinimumBasicScenario-1695342882 Jul 27 04:36:02.781530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 1241f54e5ce2416783c5a401e3eded2a Jul 27 04:36:02.781530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1695342882 Jul 27 04:36:02.781530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-TestMinimumBasicScenario-1695342882-project Jul 27 04:36:02.781530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:36:02.781530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:36:02.781530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: f92df6bb851642769a0b7d7b92f5973a Jul 27 04:36:02.781530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-TestMinimumBasicScenario-1695342882-project Jul 27 04:36:02.781530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:36:02.781530 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 is not attached to volume c5934ac0-9837-41de-be22-9d2a19d86654 Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'server_id': '1cec6f2d-6654-4661-bf6b-27950496d5b7', 'id': 'c5934ac0-9837-41de-be22-9d2a19d86654'} Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c5934ac0-9837-41de-be22-9d2a19d86654. Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:36:02.782471 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 is not attached to volume c5934ac0-9837-41de-be22-9d2a19d86654 Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 is not attached to volume c5934ac0-9837-41de-be22-9d2a19d86654 Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:36:02.784892 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-7441cfb8-179d-4f5c-af28-51fdb5a36dd5 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Returning 404 to user: Instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 is not attached to volume c5934ac0-9837-41de-be22-9d2a19d86654 {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:36:02.786358 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-7441cfb8-179d-4f5c-af28-51fdb5a36dd5 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/os-volume_attachments/c5934ac0-9837-41de-be22-9d2a19d86654" status: 404 len: 154 microversion: 2.1 time: 0.096046 Jul 27 04:36:02.786358 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 512/1014] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Jul 27 04:36:02 2022] DELETE /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7/os-volume_attachments/c5934ac0-9837-41de-be22-9d2a19d86654 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:36:03.923541 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-6198f036-4b48-4f48-8c79-c353bc069fd6 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:36:03.924104 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6198f036-4b48-4f48-8c79-c353bc069fd6 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:36:03.931335 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6198f036-4b48-4f48-8c79-c353bc069fd6 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:03.931781 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6198f036-4b48-4f48-8c79-c353bc069fd6 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:03.932547 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6198f036-4b48-4f48-8c79-c353bc069fd6 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:03.932978 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-6198f036-4b48-4f48-8c79-c353bc069fd6 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:03.959942 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-6198f036-4b48-4f48-8c79-c353bc069fd6 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Going to try to terminate instance {{(pid=117739) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 04:36:04.036015 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-6198f036-4b48-4f48-8c79-c353bc069fd6 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 204 len: 0 microversion: 2.1 time: 0.116088 Jul 27 04:36:04.036921 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 503/1015] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Jul 27 04:36:03 2022] DELETE /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 04:36:04.045493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-c231f616-8c4e-4091-b94e-ee70c2cdeddf tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:36:04.046260 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-c231f616-8c4e-4091-b94e-ee70c2cdeddf tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:36:04.053149 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c231f616-8c4e-4091-b94e-ee70c2cdeddf tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:04.053585 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c231f616-8c4e-4091-b94e-ee70c2cdeddf tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:04.054413 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c231f616-8c4e-4091-b94e-ee70c2cdeddf tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:04.054852 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-c231f616-8c4e-4091-b94e-ee70c2cdeddf tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:04.193592 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.policy [None req-c231f616-8c4e-4091-b94e-ee70c2cdeddf tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117740) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:36:04.202362 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-c231f616-8c4e-4091-b94e-ee70c2cdeddf tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1555 microversion: 2.1 time: 0.160839 Jul 27 04:36:04.203992 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 513/1016] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:36:04 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:36:05.224596 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-1d546ef1-fed2-4a4d-8fc7-27c7fbe6a4f9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:36:05.225281 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-1d546ef1-fed2-4a4d-8fc7-27c7fbe6a4f9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:36:05.231628 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1d546ef1-fed2-4a4d-8fc7-27c7fbe6a4f9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:05.232065 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1d546ef1-fed2-4a4d-8fc7-27c7fbe6a4f9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:05.232823 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1d546ef1-fed2-4a4d-8fc7-27c7fbe6a4f9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:05.233407 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-1d546ef1-fed2-4a4d-8fc7-27c7fbe6a4f9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:05.363059 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-1d546ef1-fed2-4a4d-8fc7-27c7fbe6a4f9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:36:05.370441 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-1d546ef1-fed2-4a4d-8fc7-27c7fbe6a4f9 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1555 microversion: 2.1 time: 0.150171 Jul 27 04:36:05.371120 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 504/1017] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:36:05 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:36:06.137691 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [req-c5928af1-2aec-4efe-882b-d2381bf4c3c4 req-40b51705-ed77-42d7-bca4-95afccf6ce87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cec6f2d-6654-4661-bf6b-27950496d5b7", "name": "network-vif-deleted", "tag": "75a5a121-f042-4322-a52a-a2c9a18e85b2"}]} {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 04:36:06.148677 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-c5928af1-2aec-4efe-882b-d2381bf4c3c4 req-40b51705-ed77-42d7-bca4-95afccf6ce87 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:06.149126 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [req-c5928af1-2aec-4efe-882b-d2381bf4c3c4 req-40b51705-ed77-42d7-bca4-95afccf6ce87 service nova] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:06.161760 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.compute.server_external_events [req-c5928af1-2aec-4efe-882b-d2381bf4c3c4 req-40b51705-ed77-42d7-bca4-95afccf6ce87 service nova] Creating event network-vif-deleted:75a5a121-f042-4322-a52a-a2c9a18e85b2 for instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 on hv-cinder-85098 Jul 27 04:36:06.166754 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [req-c5928af1-2aec-4efe-882b-d2381bf4c3c4 req-40b51705-ed77-42d7-bca4-95afccf6ce87 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032780 Jul 27 04:36:06.167354 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 514/1018] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jul 27 04:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 04:36:06.392929 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-f472dc01-c365-4425-ab0f-01dcd11e4787 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:36:06.393518 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.compute.api [None req-f472dc01-c365-4425-ab0f-01dcd11e4787 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117739) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:36:06.400084 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f472dc01-c365-4425-ab0f-01dcd11e4787 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:06.400523 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f472dc01-c365-4425-ab0f-01dcd11e4787 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:06.401299 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f472dc01-c365-4425-ab0f-01dcd11e4787 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:06.401733 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f472dc01-c365-4425-ab0f-01dcd11e4787 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:06.434837 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f472dc01-c365-4425-ab0f-01dcd11e4787 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:06.435282 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG oslo_concurrency.lockutils [None req-f472dc01-c365-4425-ab0f-01dcd11e4787 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:06.435925 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.objects.instance [None req-f472dc01-c365-4425-ab0f-01dcd11e4787 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lazy-loading 'fault' on Instance uuid 1cec6f2d-6654-4661-bf6b-27950496d5b7 {{(pid=117739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 04:36:06.482135 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.policy [None req-f472dc01-c365-4425-ab0f-01dcd11e4787 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f92df6bb851642769a0b7d7b92f5973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1241f54e5ce2416783c5a401e3eded2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117739) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 04:36:06.491758 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-f472dc01-c365-4425-ab0f-01dcd11e4787 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 200 len: 1349 microversion: 2.1 time: 0.102628 Jul 27 04:36:06.492345 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 505/1019] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:36:06 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 04:36:07.514831 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-45244358-be12-4541-b64c-43faae4c0965 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '>' {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:36:07.515531 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.compute.api [None req-45244358-be12-4541-b64c-43faae4c0965 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] [instance: 1cec6f2d-6654-4661-bf6b-27950496d5b7] Fetching instance by UUID {{(pid=117740) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 04:36:07.521873 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-45244358-be12-4541-b64c-43faae4c0965 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:07.522365 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-45244358-be12-4541-b64c-43faae4c0965 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:07.523125 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-45244358-be12-4541-b64c-43faae4c0965 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 04:36:07.523562 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG oslo_concurrency.lockutils [None req-45244358-be12-4541-b64c-43faae4c0965 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Lock "830f8882-12e3-4311-ad7f-da8e13e981d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 04:36:07.536882 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.wsgi [None req-45244358-be12-4541-b64c-43faae4c0965 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] HTTP exception thrown: Instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 could not be found. Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-45244358-be12-4541-b64c-43faae4c0965 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Request method failure captured: Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: request: GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 HTTP/1.1 Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept: application/json Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Accept-Encoding: identity Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Connection: close Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Length: 0 Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Content-Type: application/json Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Host: 10.222.0.46 Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Openstack-System-Scope: None Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: User-Agent: python-urllib3/1.26.10 Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Auth-Token: gAAAAABi4MA-6C6UAWETm0kf85PBDGV_oBjvS9fu2YnqQbfwT2LbidAC4Puz772TEj3qXVKX7S3Xu7eFBo-yKUb7Qda8HuHcg4HhMR-bI1Z5k7VogAAZ_9kFcfQG0luTQuL2opJTe6feVHcy2mRi4x1PtvaGnBqRhjP3bommsIuPs2iSFHjlLeo Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Id: None Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Domain-Name: None Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Identity-Status: Confirmed Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Is-Admin-Project: True Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Id: default Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Domain-Name: Default Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Id: 1241f54e5ce2416783c5a401e3eded2a Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Project-Name: tempest-TestMinimumBasicScenario-1695342882 Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Role: reader,member Jul 27 04:36:07.538493 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Roles: reader,member Jul 27 04:36:07.539950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1241f54e5ce2416783c5a401e3eded2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1241f54e5ce2416783c5a401e3eded2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1241f54e5ce2416783c5a401e3eded2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1241f54e5ce2416783c5a401e3eded2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jul 27 04:36:07.539950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant: tempest-TestMinimumBasicScenario-1695342882 Jul 27 04:36:07.539950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Id: 1241f54e5ce2416783c5a401e3eded2a Jul 27 04:36:07.539950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1695342882 Jul 27 04:36:07.539950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User: tempest-TestMinimumBasicScenario-1695342882-project Jul 27 04:36:07.539950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Id: default Jul 27 04:36:07.539950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Domain-Name: Default Jul 27 04:36:07.539950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Id: f92df6bb851642769a0b7d7b92f5973a Jul 27 04:36:07.539950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: X-User-Name: tempest-TestMinimumBasicScenario-1695342882-project Jul 27 04:36:07.539950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: method: > Jul 27 04:36:07.539950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: exception: Instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 could not be found. Jul 27 04:36:07.539950 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: action_args: {'id': '1cec6f2d-6654-4661-bf6b-27950496d5b7'} Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: {{(pid=117740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 could not be found. Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 04:36:07.540730 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 could not be found. Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 could not be found. Jul 27 04:36:07.542230 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: ERROR nova.api.openstack.wsgi Jul 27 04:36:07.543727 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: DEBUG nova.api.openstack.wsgi [None req-45244358-be12-4541-b64c-43faae4c0965 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Returning 404 to user: Instance 1cec6f2d-6654-4661-bf6b-27950496d5b7 could not be found. {{(pid=117740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 04:36:07.543727 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO nova.api.openstack.requestlog [None req-45244358-be12-4541-b64c-43faae4c0965 tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7" status: 404 len: 111 microversion: 2.1 time: 0.029734 Jul 27 04:36:07.543727 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: [pid: 117740|app: 0|req: 515/1020] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Jul 27 04:36:07 2022] GET /compute/v2.1/servers/1cec6f2d-6654-4661-bf6b-27950496d5b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 04:36:07.548326 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: DEBUG nova.api.openstack.wsgi [None req-a03b2952-f1b9-47b5-a21f-6a4de6ba6fbd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] Calling method '.version_select at 0x7f21d5a96e50>' {{(pid=117739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 04:36:07.567371 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO nova.api.openstack.requestlog [None req-a03b2952-f1b9-47b5-a21f-6a4de6ba6fbd tempest-TestMinimumBasicScenario-1695342882 tempest-TestMinimumBasicScenario-1695342882-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1908369653" status: 202 len: 0 microversion: 2.1 time: 0.022756 Jul 27 04:36:07.567965 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: [pid: 117739|app: 0|req: 506/1021] 10.222.0.46 () {58 vars in 1272 bytes} [Wed Jul 27 04:36:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1908369653 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 04:36:50.501040 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 04:36:50.501740 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Wed Jul 27 04:36:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 04:37:26.700631 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 04:37:26.701450 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Wed Jul 27 04:37:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 04:38:31.120098 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 04:38:31.120706 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Wed Jul 27 04:38:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 04:38:53.738123 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 04:38:53.738764 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Wed Jul 27 04:38:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 04:40:10.511321 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 04:40:10.511921 dv-cinder-850989-2-iscsi devstack@n-api.service[117739]: Wed Jul 27 04:40:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 04:40:46.709820 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 04:40:46.710411 dv-cinder-850989-2-iscsi devstack@n-api.service[117740]: Wed Jul 27 04:40:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!